Jul 17 05:20:06 devstack cinder-volume[76140]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 05:20:06 devstack cinder-volume[76140]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 05:20:06 devstack cinder-volume[76140]: we strongly recommend against using it for new projects. Jul 17 05:20:06 devstack cinder-volume[76140]: If you are already using Eventlet, we recommend migrating to a different Jul 17 05:20:06 devstack cinder-volume[76140]: framework. For more detail see Jul 17 05:20:06 devstack cinder-volume[76140]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 05:20:06 devstack cinder-volume[76140]: import eventlet # noqa Jul 17 05:20:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 05:20:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 05:20:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 05:20:10 devstack cinder-volume[76140]: INFO dbcounter [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Registered counter for database cinder Jul 17 05:20:10 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:20:10 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writer thread running {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 05:20:10 devstack cinder-volume[76140]: INFO cinder.rpc [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 05:20:10 devstack cinder-volume[76140]: INFO cinder.rpc [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 05:20:10 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:20:11 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Determined volume DB was empty at startup. Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76140) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 05:20:11 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 05:20:11 devstack cinder-volume[76140]: WARNING stevedore.named [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 05:20:11 devstack cinder-volume[76140]: WARNING castellan.key_manager [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 05:20:11 devstack cinder-volume[76140]: WARNING cinder.keymgr.conf_key_mgr [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76140) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] CMD "cinder-rtstool verify" returned: 0 in 0.525s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:20:11 devstack cinder-volume[76140]: INFO cinder.rpc [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 17 05:20:11 devstack cinder-volume[76140]: INFO cinder.rpc [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 17 05:20:11 devstack cinder-volume[76140]: WARNING stevedore.named [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 05:20:11 devstack cinder-volume[76140]: WARNING castellan.key_manager [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 05:20:11 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:20:11 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Starting 1 workers Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Started child 76275 {{(pid=76140) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Full set of CONF: {{(pid=76140) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] ******************************************************************************** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Configuration options gathered from: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] ================================================================================ {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] allow_availability_zone_fallback = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] allow_compression_on_image_upload = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] allowed_direct_url_schemes = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] api_rate_limit = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] auth_strategy = keystone {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] az_cache_duration = 3600 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_host = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_stats_polling_interval = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backup_api_class = cinder.backup.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76275]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backup_name_template = backup-%s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backup_use_same_host = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backup_use_temp_snapshot = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] chap_password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] chap_username = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_internal_tenant_project_id = 28bbf3df6baa45caa1ca347355c3c906 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_internal_tenant_user_id = e10c0d2619e747f5bf8fd75a589246b2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cloned_volume_same_az = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cluster = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] compression_format = gzip {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] compute_api_class = cinder.compute.nova.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] config_dir = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] config_source = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] control_exchange = openstack {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] debug = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] default_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] default_group_type = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] default_volume_type = lvmdriver-1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] disk_geometry = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] driver_client_cert = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] driver_client_cert_key = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] driver_data_namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] driver_ssl_cert_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] driver_ssl_cert_verify = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] driver_use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] enable_force_upload = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] enable_new_services = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] enable_unsupported_driver = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] enabled_backends = ['lvmdriver-1'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] enforce_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] filter_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_api_insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_api_ssl_compression = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_ca_certificates_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_catalog_info = image:glance:publicURL {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_num_retries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance_request_timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] goodness_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] graceful_shutdown_timeout = 5 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] group_api_class = cinder.group.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] host = devstack {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_compress_on_upload = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_conversion_address_space_limit = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_conversion_cpu_limit = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_conversion_disable = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_upload_use_cinder_backend = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_upload_use_internal_tenant = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_volume_cache_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_volume_cache_max_count = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] image_volume_cache_max_size_gb = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] init_host_max_objects_retrieval = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] instance_format = [instance: %(uuid)s] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] iscsi_target_flags = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] iscsi_write_cache = on {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] iser_helper = tgtadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] iser_ip_address = 192.168.122.251 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] iser_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_color = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_config_append = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_dir = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_options = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_rotate_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_rotate_interval_type = days {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] log_rotation_type = none {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] max_age = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] max_logfile_count = 30 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] max_logfile_size_mb = 200 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] max_over_subscription_ratio = 20.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] message_reap_interval = 86400 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] message_ttl = 2592000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] migration_create_volume_timeout_secs = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] monkey_patch = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] monkey_patch_modules = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] my_ip = 192.168.122.251 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] no_snapshot_gb_quota = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] num_iser_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] num_shell_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] num_volume_device_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] nvmeof_conn_info_version = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] nvmet_ns_id = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] nvmet_port_id = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] osapi_max_limit = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] osapi_volume_ext_list = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] osapi_volume_listen = 0.0.0.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] osapi_volume_listen_port = 8776 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] osapi_volume_use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] osapi_volume_workers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] per_volume_size_limit = -1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] periodic_fuzzy_delay = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] periodic_interval = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] project_id_regex = [0-9a-f\-]+ {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] public_endpoint = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] publish_errors = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] quota_backup_gigabytes = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] quota_backups = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] quota_gigabytes = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] quota_groups = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] quota_snapshots = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] quota_volumes = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] rate_limit_burst = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] rate_limit_except_level = CRITICAL {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] rate_limit_interval = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] reinit_driver_count = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] replication_device = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] report_discard_supported = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] report_interval = 120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] reservation_clean_interval = 86400 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] reservation_expire = 86400 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] reserved_image_namespaces = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] reserved_percentage = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] rpc_response_timeout = 120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] run_external_periodic_tasks = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] scst_target_driver = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] scst_target_iqn_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_down_time = 720 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] shell_completion = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] snapshot_name_template = snapshot-%s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] snapshot_same_host = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] state_path = /opt/stack/data/cinder {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] storage_availability_zone = nova {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] storage_protocol = iSCSI {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] syslog_log_facility = LOG_USER {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] target_helper = lioadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] target_ip_address = 192.168.122.251 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] target_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] target_protocol = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] target_secondary_ip_addresses = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] trace_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] transfer_api_class = cinder.transfer.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] transport_url = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] until_refresh = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] use_chap_auth = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] use_default_quota_class = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] use_journal = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] use_json = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] use_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] use_stderr = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] use_syslog = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] verify_glance_signatures = enabled {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_api_class = cinder.volume.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_backend_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_clear = zero {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_clear_ionice = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_clear_size = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_copy_bps_limit = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_dd_blocksize = 1M {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_name_template = volume-%s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_service_inithost_offload = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volume_usage_audit_period = month {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] zoning_mode = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_concurrency.disable_process_locking = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.auth_type = password {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.auth_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.cache = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.delay_auth_decision = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.http_connect_timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.include_service_catalog = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.interface = public {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_password = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcache_username = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.region_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.service_token_roles_required = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.service_type = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.token_cache_time = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.backend = dogpile.cache.null {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.backend_argument = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.backend_expiration_time = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.config_prefix = cache.oslo {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.debug_cache_backend = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.enable_retry_client = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.enable_socket_keepalive = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.expiration_time = 600 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.hashclient_retry_attempts = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.memcache_dead_retry = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.memcache_pool_maxsize = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.memcache_sasl_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.proxies = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.redis_db = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.redis_sentinel_service_name = mymaster {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.redis_server = localhost:6379 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.retry_attempts = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.retry_delay = 0.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.socket_keepalive_count = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.socket_keepalive_idle = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.socket_keepalive_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.socket_timeout = 1.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.tls_allowed_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.tls_cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.tls_certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.tls_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.tls_keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cache.username = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] coordination.backend_url = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.asyncio_connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.asyncio_slave_connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.backend = sqlalchemy {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.connection_debug = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.connection_parameters = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.connection_recycle_time = 3600 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.connection_trace = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.db_inc_retry_interval = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.db_max_retries = 20 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.db_max_retry_interval = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.db_retry_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.max_overflow = 50 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.max_pool_size = 5 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.max_retries = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.mysql_wsrep_sync_wait = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.pool_timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.retry_interval = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.slave_connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.sqlite_synchronous = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.synchronous_reader = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] database.use_db_reconnect = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.connection_string = messaging:// {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.es_doc_type = notification {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.es_scroll_size = 10000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.es_scroll_time = 2m {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.filter_error_trace = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.hmac_keys = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.sentinel_service_name = mymaster {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.socket_timeout = 0.1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.trace_requests = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler.trace_sqlalchemy = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler_jaeger.process_tags = {} {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler_jaeger.service_name_prefix = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] profiler_otlp.service_name_prefix = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.enforce_new_defaults = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.policy_default_rule = default {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.policy_file = policy.yaml {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_policy.remote_timeout = 60.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] privsep_osbrick.group = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] privsep_osbrick.helper_command = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] privsep_osbrick.user = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_sys_admin.group = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_sys_admin.helper_command = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] cinder_sys_admin.user = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.auth_type = password {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.send_service_user_token = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] service_user.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:11 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.auth_type = password {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.region_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] glance.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.backend_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.chap_password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.chap_username = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.disk_geometry = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.driver_client_cert = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.driver_client_cert_key = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.driver_data_namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.driver_use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.enable_unsupported_driver = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.extra_capabilities = {} {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.filter_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.goodness_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.iscsi_target_flags = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.iscsi_write_cache = on {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.iser_helper = tgtadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.iser_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.lvm_mirrors = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.lvm_share_target = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.lvm_type = auto {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.num_shell_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.nvmet_port_id = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.replication_device = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.report_discard_supported = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.reserved_percentage = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.scst_target_driver = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.scst_target_iqn_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.storage_protocol = iSCSI {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.target_helper = tgtadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.target_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.target_protocol = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.trace_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.unique_fqdn_network = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.use_chap_auth = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_backend_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_clear = zero {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_clear_ionice = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_clear_size = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volume_group = cinder-volumes {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_reports.file_event_handler = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_reports.log_dir = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.backend_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.backend_host = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.chap_password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.chap_username = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.chiscsi_conf = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.disk_geometry = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.driver_client_cert = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.driver_data_namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.driver_use_ssl = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.extra_capabilities = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.filter_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.goodness_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.iser_helper = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.iser_ip_address = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.iser_port = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.iser_target_prefix = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.lvm_conf_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.lvm_mirrors = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.lvm_share_target = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.lvm_type = auto {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.num_shell_tries = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.nvmet_port_id = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.replication_device = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.report_discard_supported = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.reserved_percentage = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.scst_target_driver = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.storage_protocol = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.target_helper = lioadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.target_ip_address = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.target_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.target_protocol = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.trace_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.use_chap_auth = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_clear = zero {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_clear_size = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] lvmdriver-1.volumes_dir = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.ssl_version = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_notifications.driver = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_notifications.retry = -1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] oslo_messaging_notifications.transport_url = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] key_manager.fixed_key = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.barbican_api_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.barbican_endpoint = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.barbican_endpoint_type = public {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.barbican_region_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.number_of_retries = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.retry_delay = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.send_service_user_token = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.verify_ssl = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican.verify_ssl_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.auth_type = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] barbican_service_user.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.approle_role_id = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.approle_secret_id = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.auth_method = approle {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.auth_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.kv_mountpoint = secret {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.kv_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack sudo[76303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.kv_version = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.root_token_id = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.ssl_ca_crt_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.timeout = 60.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.token_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.token_role = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack sudo[76303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:20:12 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] ******************************************************************************** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 05:20:12 devstack sudo[76303]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:12 devstack sudo[76428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:12 devstack sudo[76428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:12 devstack sudo[76428]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.250s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:20:12 devstack cinder-volume[76275]: INFO cinder.brick.local_dev.lvm [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:12 devstack sudo[76520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:20:12 devstack sudo[76520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:12 devstack sudo[76520]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG cinder.brick.local_dev.lvm [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76275) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 17 05:20:12 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:12 devstack sudo[76613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:12 devstack sudo[76613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:13 devstack sudo[76613]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.526s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:13 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:13 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:13 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:13 devstack sudo[76886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 17 05:20:13 devstack sudo[76886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:13 devstack sudo[76886]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:13 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:13 devstack sudo[76890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:20:13 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:14 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:14 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:14 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:14 devstack sudo[76973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:20:14 devstack sudo[76973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:14 devstack sudo[76973]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:14 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:14 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:14 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:20:14 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:14 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:14 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:14 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:14 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:14 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:15 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:15 devstack sudo[77069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:15 devstack sudo[77069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:15 devstack sudo[77069]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:15 devstack cinder-volume[76275]: INFO cinder.volume.drivers.lvm [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:15 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:15 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:15 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:15 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:20:15 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:15 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:15 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:15 devstack sudo[77079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:20:15 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:16 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:16 devstack sudo[77088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:16 devstack sudo[77088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:16 devstack sudo[77088]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:16 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:20:16 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:16 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:16 devstack cinder-volume[76275]: INFO cinder.volume.driver [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG cinder.volume.driver [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76275) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG oslo_db.sqlalchemy.engines [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writer thread running {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG cinder.db.api [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Building query based on filter {{(pid=76275) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG cinder.image.image_utils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76275) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 05:20:16 devstack cinder-volume[76275]: INFO cinder.keymgr.migration [None req-3109a16d-9373-4e51-b49b-403ee241df1d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 05:20:16 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:16 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:20:16 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:17 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:17 devstack sudo[77099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:20:17 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:17 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:17 devstack sudo[77103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:17 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:17 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:17 devstack sudo[77106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:20:17 devstack sudo[77106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:17 devstack sudo[77106]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:20:17 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Driver initialization completed successfully. Jul 17 05:20:17 devstack cinder-volume[76275]: INFO cinder.manager [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Initiating service 2 cleanup Jul 17 05:20:17 devstack cinder-volume[76275]: INFO cinder.manager [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Service 2 cleanup completed. Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG cinder.service [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Creating RPC server for service cinder-volume {{(pid=76275) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 05:20:17 devstack cinder-volume[76275]: DEBUG cinder.service [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76275) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 05:20:18 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:18 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:20:18 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:18 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:18 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:20:18 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:18 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:18 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:20:18 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:18 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:18 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:20:18 devstack sudo[77120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:20:18 devstack sudo[77120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:20:19 devstack sudo[77120]: pam_unix(sudo:session): session closed for user root Jul 17 05:20:19 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:20:19 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-039f0d22-e169-4997-93e9-66c0dcbfb8b4 None None] Driver post RPC initialization completed successfully. Jul 17 05:20:21 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:20:29 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:20:29 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:21:01 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:21:01 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:21:01 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread info: [<_MainThread(MainThread, started 132006580420736)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:22:01 devstack sudo[82348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:22:01 devstack sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:22:01 devstack sudo[82348]: pam_unix(sudo:session): session closed for user root Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:22:01 devstack sudo[82351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:22:01 devstack sudo[82351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:22:01 devstack sudo[82351]: pam_unix(sudo:session): session closed for user root Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:22:01 devstack sudo[82354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:22:01 devstack sudo[82354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:22:01 devstack sudo[82354]: pam_unix(sudo:session): session closed for user root Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:22:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:22:01 devstack sudo[82357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:22:01 devstack sudo[82357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:22:02 devstack sudo[82357]: pam_unix(sudo:session): session closed for user root Jul 17 05:22:02 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:22:02 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:22:02 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:22:02 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:22:02 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread info: [<_MainThread(MainThread, started 132006580420736)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:22:29 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:22:29 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:23:01 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:23:01 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:23:01 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:23:01 devstack sudo[83911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:23:01 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:23:01 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:23:01 devstack sudo[83922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:23:01 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:23:01 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:23:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:23:01 devstack sudo[83940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:23:01 devstack sudo[83940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:23:02 devstack sudo[83940]: pam_unix(sudo:session): session closed for user root Jul 17 05:23:02 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:23:02 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:23:02 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:23:02 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:23:02 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread info: [<_MainThread(MainThread, started 132006580420736)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:01 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 05:24:01 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:01 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:01 devstack sudo[85317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:24:01 devstack sudo[85317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:01 devstack sudo[85317]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:01 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 05:24:01 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:01 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:01 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:01 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 05:24:01 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:02 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:02 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:02 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:24:02 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:24:02 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:24:02 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-d3d59244-1b06-4caa-946d-fc3c0b75eae5 None None] thread info: [<_MainThread(MainThread, started 132006580420736)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:24:29 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:24:29 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:24:48 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Caught SIGTERM, stopping children Jul 17 05:24:48 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Acquiring lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 05:24:48 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Acquired lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 05:24:48 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Releasing lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 05:24:48 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Stop services. {{(pid=76140) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 05:24:48 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Killing children. {{(pid=76140) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 05:24:48 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Waiting on 1 children to exit Jul 17 05:24:52 devstack cinder-volume[76275]: DEBUG oslo_concurrency.lockutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Acquiring lock "singleton_lock" {{(pid=76275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 05:24:52 devstack cinder-volume[76275]: DEBUG oslo_concurrency.lockutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Acquired lock "singleton_lock" {{(pid=76275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 05:24:52 devstack cinder-volume[76275]: DEBUG oslo_concurrency.lockutils [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Releasing lock "singleton_lock" {{(pid=76275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 05:24:53 devstack cinder-volume[76275]: WARNING amqp [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 05:24:53 devstack cinder-volume[76275]: WARNING amqp [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 05:24:53 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-b5053f1a-b8c2-476e-b0db-e05484d144ed None None] Child 76275 exited with status 0 Jul 17 05:24:53 devstack cinder-volume[86379]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 05:24:53 devstack cinder-volume[86379]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 05:24:53 devstack cinder-volume[86379]: we strongly recommend against using it for new projects. Jul 17 05:24:53 devstack cinder-volume[86379]: If you are already using Eventlet, we recommend migrating to a different Jul 17 05:24:53 devstack cinder-volume[86379]: framework. For more detail see Jul 17 05:24:53 devstack cinder-volume[86379]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 05:24:53 devstack cinder-volume[86379]: import eventlet # noqa Jul 17 05:24:55 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 05:24:55 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 05:24:55 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 05:24:56 devstack cinder-volume[86379]: INFO dbcounter [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Registered counter for database cinder Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG dbcounter [-] [86379] Writer thread running {{(pid=86379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 05:24:56 devstack cinder-volume[86379]: INFO cinder.rpc [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 05:24:56 devstack cinder-volume[86379]: INFO cinder.rpc [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:24:56 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Determined volume DB was empty at startup. Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG cinder.volume.manager [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86379) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 05:24:56 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 05:24:56 devstack cinder-volume[86379]: WARNING stevedore.named [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 05:24:56 devstack cinder-volume[86379]: WARNING castellan.key_manager [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 05:24:56 devstack cinder-volume[86379]: WARNING cinder.keymgr.conf_key_mgr [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 05:24:56 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:24:56 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Starting 1 workers Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Started child 86598 {{(pid=86379) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Full set of CONF: {{(pid=86379) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Configuration options gathered from: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] ================================================================================ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] allow_availability_zone_fallback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] allow_compression_on_image_upload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] allowed_direct_url_schemes = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] api_rate_limit = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] auth_strategy = keystone {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_stats_polling_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backup_api_class = cinder.backup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86598]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backup_name_template = backup-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backup_use_same_host = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_internal_tenant_project_id = 28bbf3df6baa45caa1ca347355c3c906 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_internal_tenant_user_id = e10c0d2619e747f5bf8fd75a589246b2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cluster = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] compression_format = gzip {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] config_dir = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] config_source = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] control_exchange = openstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] debug = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] default_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] default_group_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] default_volume_type = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] enable_new_services = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_api_insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_api_ssl_compression = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_ca_certificates_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_num_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance_request_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] graceful_shutdown_timeout = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] group_api_class = cinder.group.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] host = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_compress_on_upload = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_conversion_address_space_limit = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_conversion_cpu_limit = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_conversion_disable = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] init_host_max_objects_retrieval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] instance_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:56 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] iser_ip_address = 192.168.122.251 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_color = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_config_append = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_options = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86598]: INFO cinder.volume.manager [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Starting volume driver QuobyteDriver (1.2) Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.remotefs [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86598) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_rotate_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_rotate_interval_type = days {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] log_rotation_type = none {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] max_age = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] max_logfile_count = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] max_logfile_size_mb = 200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] message_reap_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] message_ttl = 2592000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] monkey_patch = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] monkey_patch_modules = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] my_ip = 192.168.122.251 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] no_snapshot_gb_quota = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] osapi_max_limit = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] osapi_volume_ext_list = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] osapi_volume_listen_port = 8776 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] osapi_volume_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] osapi_volume_workers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] per_volume_size_limit = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] periodic_fuzzy_delay = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] periodic_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] public_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] publish_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] quota_backup_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] quota_backups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] quota_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] quota_groups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] quota_snapshots = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] quota_volumes = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] rate_limit_burst = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] rate_limit_except_level = CRITICAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] rate_limit_interval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] reinit_driver_count = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] report_interval = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] reservation_clean_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] reservation_expire = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] reserved_image_namespaces = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] rpc_response_timeout = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] run_external_periodic_tasks = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_down_time = 720 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] shell_completion = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] snapshot_name_template = snapshot-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] state_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] storage_availability_zone = nova {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] syslog_log_facility = LOG_USER {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] target_helper = lioadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] target_ip_address = 192.168.122.251 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] until_refresh = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] use_default_quota_class = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] use_journal = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] use_json = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] use_stderr = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] use_syslog = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] verify_glance_signatures = enabled {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_api_class = cinder.volume.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_name_template = volume-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_service_inithost_offload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volume_usage_audit_period = month {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] zoning_mode = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.auth_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.interface = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_password = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcache_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.service_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.backend = dogpile.cache.null {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.backend_argument = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.backend_expiration_time = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.config_prefix = cache.oslo {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.debug_cache_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.enable_retry_client = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.enable_socket_keepalive = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.expiration_time = 600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.memcache_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.proxies = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.redis_db = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.redis_server = localhost:6379 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.retry_delay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.socket_keepalive_count = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.socket_keepalive_idle = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.socket_keepalive_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.socket_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cache.username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] coordination.backend_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.asyncio_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.asyncio_slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.backend = sqlalchemy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.connection_debug = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.connection_parameters = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.connection_recycle_time = 3600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.connection_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.db_inc_retry_interval = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.db_max_retries = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.db_max_retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.db_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.max_overflow = 50 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.max_pool_size = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.max_retries = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86598) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 05:24:57 devstack cinder-volume[86598]: WARNING cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 05:24:57 devstack cinder-volume[86598]: WARNING cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.pool_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Running cmd (subprocess): mount.quobyte {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.sqlite_synchronous = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.synchronous_reader = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] database.use_db_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.connection_string = messaging:// {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.es_doc_type = notification {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.es_scroll_size = 10000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.es_scroll_time = 2m {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.filter_error_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.hmac_keys = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.socket_timeout = 0.1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.trace_requests = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler.trace_sqlalchemy = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler_jaeger.process_tags = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] profiler_otlp.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.policy_default_rule = default {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] privsep_osbrick.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] privsep_osbrick.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] privsep_osbrick.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_sys_admin.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_sys_admin.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] cinder_sys_admin.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.send_service_user_token = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] glance.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.extra_capabilities = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_host = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_login = admin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_private_key = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_share_path = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.target_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_reports.file_event_handler = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_reports.log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.chap_username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.extra_capabilities = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.iser_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.iser_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.iser_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_login = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_private_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_share_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.num_shell_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.report_discard_supported = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.reserved_percentage = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.scst_target_driver = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.storage_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.target_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.target_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.target_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.target_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.use_chap_auth = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_clear = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_clear_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] QuobyteHD.volumes_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_notifications.driver = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] key_manager.fixed_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.barbican_api_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.barbican_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.barbican_endpoint_type = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.barbican_region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.number_of_retries = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.retry_delay = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.send_service_user_token = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.verify_ssl = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican.verify_ssl_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.auth_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] CMD "mount.quobyte" returned: 1 in 0.127s {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=86598) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:24:57 devstack cinder-volume[86598]: INFO cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 ... Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] barbican_service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.approle_role_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.approle_secret_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 -c /etc/quobyte/client-cinder.cfg {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.auth_method = approle {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.auth_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.kv_mountpoint = secret {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.kv_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.kv_version = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.root_token_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.token_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.token_role = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:24:57 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 05:24:57 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 -c /etc/quobyte/client-cinder.cfg Jul 17 05:24:57 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:57 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.360s {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:57 devstack cinder-volume[86598]: INFO cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 succeeded Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=86598) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.378s {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:57 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:24:57 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:57 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.235s {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:57 devstack cinder-volume[86598]: INFO cinder.volume.driver [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Driver hasn't implemented _init_vendor_properties() Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG cinder.volume.driver [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86598) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG oslo_db.sqlalchemy.engines [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG dbcounter [-] [86598] Writer thread running {{(pid=86598) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 05:24:57 devstack cinder-volume[86598]: DEBUG cinder.db.api [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Building query based on filter {{(pid=86598) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.image.image_utils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86598) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 05:24:58 devstack cinder-volume[86598]: INFO cinder.keymgr.migration [None req-137846a5-a33d-4cf7-882c-4e2b0a370b58 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=86598) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=86598) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:58 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:24:58 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:58 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.235s {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.manager [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Notifying Schedulers of capabilities ... {{(pid=86598) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:24:58 devstack cinder-volume[86598]: INFO cinder.volume.manager [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Driver initialization completed successfully. Jul 17 05:24:58 devstack cinder-volume[86598]: INFO cinder.manager [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Initiating service 3 cleanup Jul 17 05:24:58 devstack cinder-volume[86598]: INFO cinder.manager [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Service 3 cleanup completed. Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.service [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Creating RPC server for service cinder-volume {{(pid=86598) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.service [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86598) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 05:24:58 devstack cinder-volume[86598]: INFO cinder.volume.manager [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=86598) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG cinder.volume.drivers.quobyte [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=86598) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86598) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:24:58 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:24:58 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:24:58 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Jul 17 05:24:58 devstack cinder-volume[86598]: DEBUG oslo_concurrency.processutils [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.387s {{(pid=86598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:24:58 devstack cinder-volume[86598]: INFO cinder.volume.manager [None req-5f69fcfb-b7b3-479d-a7b8-5e66cb19ae2d None None] Driver post RPC initialization completed successfully. Jul 17 05:25:03 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Caught SIGTERM, stopping children Jul 17 05:25:03 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Acquiring lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 05:25:03 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Acquired lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 05:25:03 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Releasing lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 05:25:03 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Stop services. {{(pid=86379) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 05:25:03 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Killing children. {{(pid=86379) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 05:25:03 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Waiting on 1 children to exit Jul 17 05:25:06 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Acquiring lock "singleton_lock" {{(pid=86598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 05:25:06 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Acquired lock "singleton_lock" {{(pid=86598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 05:25:06 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Releasing lock "singleton_lock" {{(pid=86598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 05:25:06 devstack cinder-volume[86598]: WARNING amqp [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 05:25:06 devstack cinder-volume[86598]: WARNING amqp [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 05:25:06 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-9eb2b7c0-8896-41af-8f3f-294ed9772ed3 None None] Child 86598 exited with status 0 Jul 17 05:25:07 devstack cinder-volume[87348]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 05:25:07 devstack cinder-volume[87348]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 05:25:07 devstack cinder-volume[87348]: we strongly recommend against using it for new projects. Jul 17 05:25:07 devstack cinder-volume[87348]: If you are already using Eventlet, we recommend migrating to a different Jul 17 05:25:07 devstack cinder-volume[87348]: framework. For more detail see Jul 17 05:25:07 devstack cinder-volume[87348]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 05:25:07 devstack cinder-volume[87348]: import eventlet # noqa Jul 17 05:25:09 devstack cinder-volume[87348]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87348) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 05:25:09 devstack cinder-volume[87348]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87348) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 05:25:09 devstack cinder-volume[87348]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87348) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 05:25:10 devstack cinder-volume[87348]: INFO dbcounter [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Registered counter for database cinder Jul 17 05:25:10 devstack cinder-volume[87348]: DEBUG oslo_db.sqlalchemy.engines [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87348) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG dbcounter [-] [87348] Writer thread running {{(pid=87348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 05:25:11 devstack cinder-volume[87348]: INFO cinder.rpc [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 05:25:11 devstack cinder-volume[87348]: INFO cinder.rpc [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_db.sqlalchemy.engines [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87348) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:25:11 devstack cinder-volume[87348]: INFO cinder.volume.manager [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Determined volume DB was empty at startup. Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG cinder.volume.manager [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87348) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 05:25:11 devstack cinder-volume[87348]: WARNING stevedore.named [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 05:25:11 devstack cinder-volume[87348]: WARNING castellan.key_manager [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 05:25:11 devstack cinder-volume[87348]: WARNING cinder.keymgr.conf_key_mgr [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 05:25:11 devstack cinder-volume[87348]: INFO cinder.volume.manager [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_db.sqlalchemy.engines [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87348) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:25:11 devstack cinder-volume[87348]: INFO oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Starting 1 workers Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Started child 87750 {{(pid=87348) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Full set of CONF: {{(pid=87348) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] ******************************************************************************** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] Configuration options gathered from: {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] ================================================================================ {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] allow_availability_zone_fallback = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] allow_compression_on_image_upload = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] allowed_direct_url_schemes = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] api_rate_limit = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87750]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] auth_strategy = keystone {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_availability_zone = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_host = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_stats_polling_interval = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backup_api_class = cinder.backup.api.API {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backup_name_template = backup-%s {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backup_use_same_host = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backup_use_temp_snapshot = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] chap_password = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] chap_username = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_internal_tenant_project_id = 28bbf3df6baa45caa1ca347355c3c906 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_internal_tenant_user_id = e10c0d2619e747f5bf8fd75a589246b2 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cluster = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] compression_format = gzip {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] compute_api_class = cinder.compute.nova.API {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] config_dir = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] config_source = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] control_exchange = openstack {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] debug = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] default_availability_zone = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] default_group_type = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] default_volume_type = QuobyteHD {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] disk_geometry = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] driver_client_cert = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] driver_client_cert_key = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] driver_data_namespace = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] driver_ssl_cert_path = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] driver_ssl_cert_verify = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] driver_use_ssl = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] enable_new_services = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] enable_unsupported_driver = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] enabled_backends = ['QuobyteHD'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] enforce_multipath_for_image_xfer = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] filter_function = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_api_insecure = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_api_ssl_compression = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_ca_certificates_file = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_catalog_info = image:glance:publicURL {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_num_retries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance_request_timeout = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] goodness_function = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] graceful_shutdown_timeout = 5 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] group_api_class = cinder.group.api.API {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] host = devstack {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_compress_on_upload = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_conversion_address_space_limit = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_conversion_cpu_limit = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_conversion_disable = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_upload_use_cinder_backend = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_upload_use_internal_tenant = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_volume_cache_enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_volume_cache_max_count = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] image_volume_cache_max_size_gb = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] init_host_max_objects_retrieval = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] instance_format = [instance: %(uuid)s] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] iscsi_target_flags = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] iscsi_write_cache = on {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] iser_helper = tgtadm {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] iser_ip_address = 192.168.122.251 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] iser_port = 3260 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_color = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_config_append = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_dir = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_file = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_options = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_rotate_interval = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_rotate_interval_type = days {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] log_rotation_type = none {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] max_age = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] max_logfile_count = 30 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Starting volume driver QuobyteDriver (1.2) Jul 17 05:25:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87750) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] max_logfile_size_mb = 200 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] max_over_subscription_ratio = 20.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] message_reap_interval = 86400 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] message_ttl = 2592000 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] migration_create_volume_timeout_secs = 300 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] monkey_patch = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:11 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] monkey_patch_modules = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] my_ip = 192.168.122.251 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] no_snapshot_gb_quota = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] num_iser_scan_tries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] num_shell_tries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] num_volume_device_scan_tries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] nvmeof_conn_info_version = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] nvmet_ns_id = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] nvmet_port_id = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] osapi_max_limit = 1000 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] osapi_volume_ext_list = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] osapi_volume_listen_port = 8776 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] osapi_volume_use_ssl = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] osapi_volume_workers = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] per_volume_size_limit = -1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] periodic_fuzzy_delay = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] periodic_interval = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] public_endpoint = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] publish_errors = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] quota_backup_gigabytes = 1000 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] quota_backups = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] quota_gigabytes = 1000 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] quota_groups = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] quota_snapshots = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] quota_volumes = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] rate_limit_burst = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] rate_limit_except_level = CRITICAL {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] rate_limit_interval = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] reinit_driver_count = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] replication_device = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] report_discard_supported = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] report_interval = 120 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] reservation_clean_interval = 86400 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] reservation_expire = 86400 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] reserved_image_namespaces = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] reserved_percentage = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] rpc_response_timeout = 120 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] run_external_periodic_tasks = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] scst_target_driver = iscsi {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] scst_target_iqn_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_down_time = 720 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] shell_completion = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] snapshot_name_template = snapshot-%s {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] split_loggers = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] state_path = /opt/stack/data/cinder {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] storage_availability_zone = nova {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] storage_protocol = iSCSI {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] syslog_log_facility = LOG_USER {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] target_helper = lioadm {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] target_ip_address = 192.168.122.251 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] target_port = 3260 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] target_protocol = iscsi {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] target_secondary_ip_addresses = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] trace_flags = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] transport_url = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] until_refresh = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] use_chap_auth = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] use_default_quota_class = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] use_journal = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] use_json = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] use_multipath_for_image_xfer = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] use_stderr = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] use_syslog = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] verify_glance_signatures = enabled {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_api_class = cinder.volume.api.API {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_backend_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_clear = zero {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_clear_ionice = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_clear_size = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_copy_bps_limit = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_dd_blocksize = 1M {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_name_template = volume-%s {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_service_inithost_offload = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volume_usage_audit_period = month {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] zoning_mode = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_concurrency.disable_process_locking = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.auth_section = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.auth_type = password {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.auth_version = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.cache = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.include_service_catalog = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.insecure = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.interface = public {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_password = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcache_username = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.region_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.service_type = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.backend = dogpile.cache.null {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.backend_argument = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.backend_expiration_time = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.config_prefix = cache.oslo {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.debug_cache_backend = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.enable_retry_client = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.enable_socket_keepalive = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.expiration_time = 600 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.hashclient_retry_attempts = 2 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.memcache_dead_retry = 300 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.memcache_pool_maxsize = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.memcache_sasl_enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.password = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.proxies = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.redis_db = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.redis_server = localhost:6379 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.retry_attempts = 2 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.retry_delay = 0.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.socket_keepalive_count = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.socket_keepalive_idle = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.socket_keepalive_interval = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.socket_timeout = 1.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.tls_allowed_ciphers = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.tls_cafile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.tls_certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.tls_enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.tls_keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cache.username = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] coordination.backend_url = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.asyncio_connection = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.asyncio_slave_connection = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.backend = sqlalchemy {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.connection = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.connection_debug = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.connection_parameters = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.connection_recycle_time = 3600 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.connection_trace = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.db_inc_retry_interval = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.db_max_retries = 20 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.db_max_retry_interval = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.db_retry_interval = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.max_overflow = 50 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.max_pool_size = 5 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.max_retries = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.mysql_wsrep_sync_wait = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.pool_timeout = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.retry_interval = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.slave_connection = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.sqlite_synchronous = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.synchronous_reader = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] database.use_db_reconnect = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.connection_string = messaging:// {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87750) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 05:25:12 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 05:25:12 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.es_doc_type = notification {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.es_scroll_size = 10000 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Running cmd (subprocess): mount.quobyte {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.es_scroll_time = 2m {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.filter_error_trace = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.hmac_keys = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.sentinel_service_name = mymaster {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.socket_timeout = 0.1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.trace_requests = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler.trace_sqlalchemy = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler_jaeger.process_tags = {} {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler_jaeger.service_name_prefix = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] profiler_otlp.service_name_prefix = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.enforce_new_defaults = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.policy_default_rule = default {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.policy_file = policy.yaml {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] privsep_osbrick.group = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] privsep_osbrick.helper_command = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] privsep_osbrick.user = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_sys_admin.group = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_sys_admin.helper_command = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] cinder_sys_admin.user = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.auth_section = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.auth_type = password {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.cafile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.collect_timing = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.insecure = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.send_service_user_token = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.split_loggers = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] service_user.timeout = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.auth_section = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.auth_type = password {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.collect_timing = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.insecure = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.region_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.split_loggers = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] glance.timeout = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.backend_availability_zone = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.chap_password = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.chap_username = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.disk_geometry = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.driver_client_cert = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.driver_client_cert_key = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.driver_data_namespace = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.driver_use_ssl = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.extra_capabilities = {} {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.filter_function = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.goodness_function = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.iscsi_target_flags = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.iscsi_write_cache = on {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.iser_helper = tgtadm {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.iser_port = 3260 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_host = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_login = admin {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_mount_options = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_password = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_private_key = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_share_path = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.num_shell_tries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.quobyte_volume_url = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.replication_device = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.report_discard_supported = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.reserved_percentage = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.target_helper = tgtadm {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.target_port = 3260 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.target_protocol = iscsi {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.trace_flags = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.unique_fqdn_network = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.use_chap_auth = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_backend_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_clear = zero {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_clear_ionice = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_clear_size = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_reports.file_event_handler = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_reports.log_dir = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.backend_availability_zone = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.backend_host = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.chap_password = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.chap_username = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.chiscsi_conf = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.disk_geometry = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.driver_client_cert = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.driver_data_namespace = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.driver_use_ssl = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.extra_capabilities = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.filter_function = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.goodness_function = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.iser_helper = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.iser_ip_address = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.iser_port = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.iser_target_prefix = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_host = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_login = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_mount_options = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_password = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_private_key = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_share_path = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_ssh_port = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.num_shell_tries = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.nvmet_port_id = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.replication_device = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.report_discard_supported = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.reserved_percentage = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.scst_target_driver = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.storage_protocol = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.target_helper = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.target_ip_address = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.target_port = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.target_prefix = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.target_protocol = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.trace_flags = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.use_chap_auth = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_clear = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_clear_size = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] QuobyteHD.volumes_dir = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.ssl = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_notifications.driver = [] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_notifications.retry = -1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] key_manager.fixed_key = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.barbican_api_version = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.barbican_endpoint = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.barbican_endpoint_type = public {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.barbican_region_name = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.cafile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.collect_timing = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.insecure = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.number_of_retries = 60 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.retry_delay = 1 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.send_service_user_token = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.split_loggers = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.timeout = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.verify_ssl = True {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican.verify_ssl_path = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.auth_section = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.auth_type = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.cafile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.certfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.collect_timing = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.insecure = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.keyfile = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.split_loggers = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] barbican_service_user.timeout = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.approle_role_id = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.approle_secret_id = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.auth_method = approle {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.auth_path = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.kv_mountpoint = secret {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.kv_path = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.kv_version = 2 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.namespace = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.root_token_id = **** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.ssl_ca_crt_file = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.timeout = 60.0 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.token_file = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.token_role = None {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.use_ssl = False {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 05:25:12 devstack cinder-volume[87348]: DEBUG oslo_service.backend._eventlet.service [None req-352087fa-1e73-4b6d-a8c5-78d78d53bd99 None None] ******************************************************************************** {{(pid=87348) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:25:12 devstack cinder-volume[87750]: INFO cinder.volume.driver [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Driver hasn't implemented _init_vendor_properties() Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.volume.driver [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_db.sqlalchemy.engines [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87750) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writer thread running {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.db.api [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Building query based on filter {{(pid=87750) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87750) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:25:12 devstack cinder-volume[87750]: INFO cinder.keymgr.migration [None req-cdbdbdf1-48f9-4422-ad11-940a8a8b709c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 05:25:12 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.329s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:25:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Driver initialization completed successfully. Jul 17 05:25:12 devstack cinder-volume[87750]: INFO cinder.manager [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Initiating service 3 cleanup Jul 17 05:25:12 devstack cinder-volume[87750]: INFO cinder.manager [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Service 3 cleanup completed. Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.service [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Creating RPC server for service cinder-volume {{(pid=87750) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.service [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87750) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 05:25:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:25:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:25:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:25:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:25:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:25:13 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:25:13 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:25:13 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Jul 17 05:25:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:25:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1541108e-00f7-4e0c-a225-e72c7da26a4d None None] Driver post RPC initialization completed successfully. Jul 17 05:25:21 devstack cinder-volume[87348]: DEBUG dbcounter [-] [87348] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:25:22 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:25:23 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:25:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d16f471-b524-4a91-a686-ee23c88ea0e7 tempest-BackendsCapabilitiesAdminTestsJSON-1654956745 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 05:25:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-94a455f1-3e71-4918-b542-404012e97529 tempest-BackendsCapabilitiesAdminTestsJSON-1654956745 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 05:25:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:25:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 6 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:25:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:26:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f3d1e612-17ca-4b2d-bc63-2101d0bd7a70 tempest-GroupsTest-1198065652 None] Group tempest-Group1-1704804067: creating Jul 17 05:26:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f3d1e612-17ca-4b2d-bc63-2101d0bd7a70 tempest-GroupsTest-1198065652 None] Group tempest-Group1-1704804067: created successfully Jul 17 05:26:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f3d1e612-17ca-4b2d-bc63-2101d0bd7a70 tempest-GroupsTest-1198065652 None] Create group completed successfully. Jul 17 05:26:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f6bbcaf5-44bf-4953-8e02-cadd399ba2bc tempest-GroupsTest-1198065652 None] Group tempest-Group2-1721721020: creating Jul 17 05:26:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f6bbcaf5-44bf-4953-8e02-cadd399ba2bc tempest-GroupsTest-1198065652 None] Group tempest-Group2-1721721020: created successfully Jul 17 05:26:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f6bbcaf5-44bf-4953-8e02-cadd399ba2bc tempest-GroupsTest-1198065652 None] Create group completed successfully. Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Flow 'volume_create_manager' (de5dc0c8-808f-4750-9f32-dbd69d3179a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01a6905-91da-4c85-a45f-f25f3e52f40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01a6905-91da-4c85-a45f-f25f3e52f40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489989367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a28749a-ca68-4075-9a19-63a4cec2444f,host='devstack@QuobyteHD#QuobyteHD',id=6100de19-f80d-4a6c-815e-4664b96902ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcfccd70d5941518dd5cfbf10d836cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:14Z,use_quota=True,user_id='f356d62ec3e64b4a899ae769a9ba8ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fde6d49b-e19a-488c-8dbb-bbbdf8efec67),volume_type_id=fde6d49b-e19a-488c-8dbb-bbbdf8efec67)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbb95ea-6875-46af-80c6-c6686942e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbb95ea-6875-46af-80c6-c6686942e45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2dd222-590a-4f51-8250-fc00692164d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2dd222-590a-4f51-8250-fc00692164d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6100de19-f80d-4a6c-815e-4664b96902ca', 'volume_name': 'volume-6100de19-f80d-4a6c-815e-4664b96902ca', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b793b762-d94b-4eea-ac3c-cab37237678c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b793b762-d94b-4eea-ac3c-cab37237678c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2fdf3e-1e43-40b2-a02f-9a9cfe49c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Volume 6100de19-f80d-4a6c-815e-4664b96902ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6100de19-f80d-4a6c-815e-4664b96902ca', 'volume_size': 1} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a28749a-ca68-4075-9a19-63a4cec2444f,created_at=2026-07-17T03:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489989367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a28749a-ca68-4075-9a19-63a4cec2444f,host='devstack@QuobyteHD#QuobyteHD',id=6100de19-f80d-4a6c-815e-4664b96902ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcfccd70d5941518dd5cfbf10d836cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:14Z,use_quota=True,user_id='f356d62ec3e64b4a899ae769a9ba8ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fde6d49b-e19a-488c-8dbb-bbbdf8efec67),volume_type_id=fde6d49b-e19a-488c-8dbb-bbbdf8efec67)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Creating volume 6100de19-f80d-4a6c-815e-4664b96902ca {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:26:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:26:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:14 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca 1073741824 Jul 17 05:26:14 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:15 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca 1073741824" returned: 0 in 1.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:16 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca Jul 17 05:26:16 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:16 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca" returned: 0 in 0.677s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:26:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.314s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2fdf3e-1e43-40b2-a02f-9a9cfe49c457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6100de19-f80d-4a6c-815e-4664b96902ca', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08215d8-8204-4181-b34e-a223616e18dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Volume volume-6100de19-f80d-4a6c-815e-4664b96902ca (6100de19-f80d-4a6c-815e-4664b96902ca): created successfully Jul 17 05:26:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08215d8-8204-4181-b34e-a223616e18dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Flow 'volume_create_manager' (de5dc0c8-808f-4750-9f32-dbd69d3179a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d8b095bc-1d70-4605-96df-0d2621c15511 tempest-GroupsTest-1198065652 None] Created volume successfully. Jul 17 05:26:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Acquiring lock "cinder-quobyte-6100de19-f80d-4a6c-815e-4664b96902ca" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Lock "cinder-quobyte-6100de19-f80d-4a6c-815e-4664b96902ca" acquired by "delete_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:19 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptwsx6e__/privsep.sock'] Jul 17 05:26:19 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptwsx6e__/privsep.sock Jul 17 05:26:19 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 05:26:21 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 17 05:26:22 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:22 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Spawned new privsep daemon via rootwrap Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Accepted privsep connection to /tmp/tmptwsx6e__/privsep.sock {{(pid=87750) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 17 05:26:22 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 17 05:26:22 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 17 05:26:22 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 17 05:26:22 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88611 Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc16db-c01b-4ba0-ab49-88f01724d4bc]: (2,) {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9106c1-8fa3-4ffa-bdc7-edbdb689e126]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Flow 'volume_create_manager' (fc0b2b1f-7d8d-47db-8cdf-fff4c8ccf39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:22 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca Jul 17 05:26:22 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784bbb12-1402-4f4f-9361-cf1e7ac18563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784bbb12-1402-4f4f-9361-cf1e7ac18563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1431086363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d313de87617b46478168d23571abbcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:22Z,use_quota=True,user_id='8c850501ced141f08d60d58b6e88700a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2268610-6885-4ce0-84b1-3d4893b78c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2268610-6885-4ce0-84b1-3d4893b78c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2d0eae-cb45-4328-a416-d0d2dc850b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2d0eae-cb45-4328-a416-d0d2dc850b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f', 'volume_name': 'volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14a5e01-57df-4310-915b-3a48697d4996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14a5e01-57df-4310-915b-3a48697d4996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d33026-ffae-41df-b0d6-e66ad936c8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Volume c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f', 'volume_size': 1} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1431086363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d313de87617b46478168d23571abbcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:22Z,use_quota=True,user_id='8c850501ced141f08d60d58b6e88700a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Creating volume c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:26:22 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:22 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f 1073741824 Jul 17 05:26:22 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:22 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca" returned: 0 in 0.689s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:22 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca Jul 17 05:26:22 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:23 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6100de19-f80d-4a6c-815e-4664b96902ca" returned: 0 in 0.604s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Lock "cinder-quobyte-6100de19-f80d-4a6c-815e-4664b96902ca" released by "delete_volume" :: held 4.047s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Created reservations ['04fa22d8-b5cc-462c-a4e9-c9f231564f15'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:23 devstack cinder-volume[87750]: WARNING cinder.quota [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1694019243 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1694019243, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:26:23 devstack cinder-volume[87750]: WARNING cinder.quota [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1694019243 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1694019243, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:26:23 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f 1073741824" returned: 0 in 1.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Created reservations ['fa9f524c-75b1-49b1-a790-4c507c1f7ccf', 'cd6a08b3-324c-458b-83c4-193b3f5e2386', 'ded985bd-370d-4686-8f6b-ea4b588aa5ac', 'dddc0132-8353-47f5-8bb8-ff0ba4ea98b0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:24 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f Jul 17 05:26:24 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:24 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:24 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:25 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f" returned: 0 in 0.649s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d33026-ffae-41df-b0d6-e66ad936c8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95525efd-09d9-4a80-9a15-ae2a345c4d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Volume volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f (c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f): created successfully Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95525efd-09d9-4a80-9a15-ae2a345c4d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Flow 'volume_create_manager' (fc0b2b1f-7d8d-47db-8cdf-fff4c8ccf39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:25 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a952e9d8-eac2-41ba-a0c4-5a5e74aef1b9 tempest-VolumesAdminNegativeTest-503126815 None] Created volume successfully. Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 1.116s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0528d913-22e6-45db-8367-40c66ab386d2 tempest-GroupsTest-1198065652 None] Delete group completed successfully. Jul 17 05:26:25 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Created reservations ['7749e8c0-af2b-428b-84d0-9e88aeaf2383'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:26 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:26 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Acquiring lock "cinder-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Lock "cinder-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:26 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.615s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-76fb6e25-6015-49c9-b85b-c47cfb2d0d6e tempest-GroupsTest-1198065652 None] Delete group completed successfully. Jul 17 05:26:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Acquiring lock "cinder-quobyte-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Lock "cinder-quobyte-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f" acquired by "delete_volume" :: waited 0.060s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9972c882-4a3f-4e5c-a807-c0d6accfbf29]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:26:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:27 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f Jul 17 05:26:27 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:28 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f" returned: 0 in 0.972s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:28 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f Jul 17 05:26:28 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a7cc22c-e3d4-4af0-bc38-cb23572f5893 tempest-GroupsTest-1198065652 None] Group tempest-GroupsTest-Group-583995097: creating Jul 17 05:26:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a7cc22c-e3d4-4af0-bc38-cb23572f5893 tempest-GroupsTest-1198065652 None] Group tempest-GroupsTest-Group-583995097: created successfully Jul 17 05:26:28 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f" returned: 0 in 0.901s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a7cc22c-e3d4-4af0-bc38-cb23572f5893 tempest-GroupsTest-1198065652 None] Create group completed successfully. Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Lock "cinder-quobyte-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f" released by "delete_volume" :: held 2.007s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:29 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:26:29 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Created reservations ['d0d1fc00-3353-46b9-b015-f1b38053db00', '0d8b3c0b-646d-4155-90fc-275e787f4b91', 'c6d93ad7-3a07-47a4-bffc-b2fe67ec94ef', '1471599f-33d6-4a84-980d-7db32abb9281'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:29 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:29 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:29 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.439s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Deleted volume successfully. Jul 17 05:26:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9ede075-1979-40b3-9773-1966d23add54 tempest-VolumesAdminNegativeTest-503126815 None] Lock "cinder-c2a903ab-bad8-4cb0-9f50-2b3fbc20fe8f-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Flow 'volume_create_manager' (f5015788-d667-4080-ac31-616a9cba7ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245fa1c2-01be-47e8-9091-6d25b262b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245fa1c2-01be-47e8-9091-6d25b262b191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-770948380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=791b5fd5-191a-4dc9-9c36-66a3fe773172,host='devstack@QuobyteHD#QuobyteHD',id=492011f8-2a29-4dcf-b996-f81e1dcead29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcfccd70d5941518dd5cfbf10d836cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:32Z,use_quota=True,user_id='f356d62ec3e64b4a899ae769a9ba8ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33990340-a968-4e7c-929c-15d0b7cfe7d6),volume_type_id=33990340-a968-4e7c-929c-15d0b7cfe7d6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490a93b2-e679-4f52-9926-2b3249352fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490a93b2-e679-4f52-9926-2b3249352fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5eedc6-e397-43b2-b791-a8a7d6ebe1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5eedc6-e397-43b2-b791-a8a7d6ebe1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492011f8-2a29-4dcf-b996-f81e1dcead29', 'volume_name': 'volume-492011f8-2a29-4dcf-b996-f81e1dcead29', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850053ba-cd17-4437-beea-b49e2d623b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850053ba-cd17-4437-beea-b49e2d623b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95484ff0-cd9d-4916-b7f8-c34230038f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Volume 492011f8-2a29-4dcf-b996-f81e1dcead29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492011f8-2a29-4dcf-b996-f81e1dcead29', 'volume_size': 1} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=791b5fd5-191a-4dc9-9c36-66a3fe773172,created_at=2026-07-17T03:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-770948380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=791b5fd5-191a-4dc9-9c36-66a3fe773172,host='devstack@QuobyteHD#QuobyteHD',id=492011f8-2a29-4dcf-b996-f81e1dcead29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcfccd70d5941518dd5cfbf10d836cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:32Z,use_quota=True,user_id='f356d62ec3e64b4a899ae769a9ba8ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33990340-a968-4e7c-929c-15d0b7cfe7d6),volume_type_id=33990340-a968-4e7c-929c-15d0b7cfe7d6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Creating volume 492011f8-2a29-4dcf-b996-f81e1dcead29 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:26:31 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:26:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:31 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 1073741824 Jul 17 05:26:31 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:32 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 1073741824" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:32 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 Jul 17 05:26:32 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:32 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29" returned: 0 in 0.486s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95484ff0-cd9d-4916-b7f8-c34230038f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492011f8-2a29-4dcf-b996-f81e1dcead29', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325df3dc-2edd-45a2-8cee-2748f4560884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Volume volume-492011f8-2a29-4dcf-b996-f81e1dcead29 (492011f8-2a29-4dcf-b996-f81e1dcead29): created successfully Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325df3dc-2edd-45a2-8cee-2748f4560884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Flow 'volume_create_manager' (f5015788-d667-4080-ac31-616a9cba7ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0875fc98-69ae-482b-8da3-83808fa0f4ec tempest-GroupsTest-1198065652 None] Created volume successfully. Jul 17 05:26:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:26:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Flow 'volume_create_manager' (e334130e-f762-4141-b0a3-67635f6edfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25638d-520a-4d9a-a977-2eb4b6b825c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25638d-520a-4d9a-a977-2eb4b6b825c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-933436055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=791b5fd5-191a-4dc9-9c36-66a3fe773172,host='devstack@QuobyteHD#QuobyteHD',id=b7675fa1-445c-49cf-b0fe-33d718406738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcfccd70d5941518dd5cfbf10d836cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:35Z,use_quota=True,user_id='f356d62ec3e64b4a899ae769a9ba8ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33990340-a968-4e7c-929c-15d0b7cfe7d6),volume_type_id=33990340-a968-4e7c-929c-15d0b7cfe7d6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0cdc65c-60e3-40d5-a648-833de8913b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0cdc65c-60e3-40d5-a648-833de8913b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0886180a-099a-4ea7-9ca4-6cd9a9cbfa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0886180a-099a-4ea7-9ca4-6cd9a9cbfa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7675fa1-445c-49cf-b0fe-33d718406738', 'volume_name': 'volume-b7675fa1-445c-49cf-b0fe-33d718406738', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7189907-d403-411b-bb19-96582fc75283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7189907-d403-411b-bb19-96582fc75283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3015dfa0-ad33-4206-8cce-26082024ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Volume b7675fa1-445c-49cf-b0fe-33d718406738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7675fa1-445c-49cf-b0fe-33d718406738', 'volume_size': 1} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=791b5fd5-191a-4dc9-9c36-66a3fe773172,created_at=2026-07-17T03:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-933436055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=791b5fd5-191a-4dc9-9c36-66a3fe773172,host='devstack@QuobyteHD#QuobyteHD',id=b7675fa1-445c-49cf-b0fe-33d718406738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcfccd70d5941518dd5cfbf10d836cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:35Z,use_quota=True,user_id='f356d62ec3e64b4a899ae769a9ba8ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33990340-a968-4e7c-929c-15d0b7cfe7d6),volume_type_id=33990340-a968-4e7c-929c-15d0b7cfe7d6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Creating volume b7675fa1-445c-49cf-b0fe-33d718406738 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:26:35 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:35 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 1073741824 Jul 17 05:26:35 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:35 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 1073741824" returned: 0 in 0.556s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:35 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 Jul 17 05:26:35 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:36 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:26:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3015dfa0-ad33-4206-8cce-26082024ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7675fa1-445c-49cf-b0fe-33d718406738', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba00fca2-e286-4399-92ea-9ded7fc7c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:36 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Volume volume-b7675fa1-445c-49cf-b0fe-33d718406738 (b7675fa1-445c-49cf-b0fe-33d718406738): created successfully Jul 17 05:26:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba00fca2-e286-4399-92ea-9ded7fc7c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Flow 'volume_create_manager' (e334130e-f762-4141-b0a3-67635f6edfa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0a8d2d00-c5bc-4039-a85a-59ca9e02c1a5 tempest-GroupsTest-1198065652 None] Created volume successfully. Jul 17 05:26:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2c8ad9e4-e698-41a5-8ec4-bcc30b9b86ab tempest-GroupsTest-1198065652 None] Update group completed successfully. Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Flow 'volume_create_manager' (ad70e152-86a5-4dc8-bad7-fd1bc7c2e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8067bd2-58d5-4a46-9818-9f4892d7c2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8067bd2-58d5-4a46-9818-9f4892d7c2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-779023518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9e0956-207d-432d-92c4-6f7a85f4a813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc119eea7234b689076e348fbfee60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:37Z,use_quota=True,user_id='46db50d0e6cf4ee1869bfc54e32ac5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f2746-89df-42f9-97bb-5695f3aae1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f2746-89df-42f9-97bb-5695f3aae1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3155852f-f9df-478b-95fa-ccdbf7fc8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3155852f-f9df-478b-95fa-ccdbf7fc8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9e0956-207d-432d-92c4-6f7a85f4a813', 'volume_name': 'volume-da9e0956-207d-432d-92c4-6f7a85f4a813', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aea1c78-3526-4255-92dd-01d65a5d8f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aea1c78-3526-4255-92dd-01d65a5d8f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed602d3f-fdd6-411f-98da-7d10968f6e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Volume da9e0956-207d-432d-92c4-6f7a85f4a813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9e0956-207d-432d-92c4-6f7a85f4a813', 'volume_size': 1} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-779023518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9e0956-207d-432d-92c4-6f7a85f4a813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc119eea7234b689076e348fbfee60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:37Z,use_quota=True,user_id='46db50d0e6cf4ee1869bfc54e32ac5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Creating volume da9e0956-207d-432d-92c4-6f7a85f4a813 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:26:37 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:37 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 1073741824 Jul 17 05:26:37 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:37 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 1073741824" returned: 0 in 0.583s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:37 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 Jul 17 05:26:37 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:38 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:26:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed602d3f-fdd6-411f-98da-7d10968f6e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9e0956-207d-432d-92c4-6f7a85f4a813', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21190e0-967f-4d57-a173-050a26abd1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Volume volume-da9e0956-207d-432d-92c4-6f7a85f4a813 (da9e0956-207d-432d-92c4-6f7a85f4a813): created successfully Jul 17 05:26:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21190e0-967f-4d57-a173-050a26abd1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Flow 'volume_create_manager' (ad70e152-86a5-4dc8-bad7-fd1bc7c2e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-26f7952d-e24c-4c10-b3ad-30903e42a95c tempest-ServersNegativeTestJSON-1259887026 None] Created volume successfully. Jul 17 05:26:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9d1e1ca0-013e-4d37-a1f6-f16a5be1dca7 tempest-GroupsTest-1198065652 None] Update group completed successfully. Jul 17 05:26:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Acquiring lock "cinder-quobyte-492011f8-2a29-4dcf-b996-f81e1dcead29" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Lock "cinder-quobyte-492011f8-2a29-4dcf-b996-f81e1dcead29" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b40fbe-b870-4d19-b701-fa829db8e6d9]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:26:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:40 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 Jul 17 05:26:40 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:40 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29" returned: 0 in 0.528s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:40 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29 Jul 17 05:26:40 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:41 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-492011f8-2a29-4dcf-b996-f81e1dcead29" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Lock "cinder-quobyte-492011f8-2a29-4dcf-b996-f81e1dcead29" released by "delete_volume" :: held 0.905s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Acquiring lock "cinder-quobyte-b7675fa1-445c-49cf-b0fe-33d718406738" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Lock "cinder-quobyte-b7675fa1-445c-49cf-b0fe-33d718406738" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f40cf-6ca6-4d1d-adea-494f99c13a65]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:41 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 Jul 17 05:26:41 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:41 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738" returned: 0 in 0.588s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:41 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738 Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:26:41 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Flow 'volume_create_manager' (64b22bc1-3d91-46fb-8273-6ec89fe3e43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb69af1-48ea-442a-a703-4c39ff7d0473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb69af1-48ea-442a-a703-4c39ff7d0473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1844803370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc119eea7234b689076e348fbfee60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:42Z,use_quota=True,user_id='46db50d0e6cf4ee1869bfc54e32ac5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f9caa6-7936-492f-bc82-3c22f3524083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f9caa6-7936-492f-bc82-3c22f3524083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0550f2c4-d002-495f-aa8c-733c8fcca637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0550f2c4-d002-495f-aa8c-733c8fcca637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf', 'volume_name': 'volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed0473f-6fcd-45b8-b135-2c0d730cb4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed0473f-6fcd-45b8-b135-2c0d730cb4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7880aa3b-3372-4bc2-adf8-3cf16acca86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Volume 0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf', 'volume_size': 1} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1844803370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc119eea7234b689076e348fbfee60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:26:42Z,use_quota=True,user_id='46db50d0e6cf4ee1869bfc54e32ac5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Creating volume 0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:26:41 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:26:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:42 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf 1073741824 Jul 17 05:26:42 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:42 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b7675fa1-445c-49cf-b0fe-33d718406738" returned: 0 in 0.328s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Lock "cinder-quobyte-b7675fa1-445c-49cf-b0fe-33d718406738" released by "delete_volume" :: held 0.962s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Created reservations ['f8c9c63d-4074-441e-b804-70e209e07247'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:42 devstack cinder-volume[87750]: WARNING cinder.quota [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-845142695 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-845142695, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:26:42 devstack cinder-volume[87750]: WARNING cinder.quota [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-845142695 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-845142695, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Created reservations ['dbe50b18-0ecb-4c5a-b780-ff914de9c488', '45c73c6f-6aec-4e2b-a0e0-46527c6960ed', 'def65192-f139-4531-ba1e-15c19ecc764b', '105d6d8f-dfa7-4390-b339-a97c7424addb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Created reservations ['1d8d1b9f-3dd3-4bb8-9205-0ad743efd11b', '5c293d4a-e199-4e5d-83cf-52bf62b21430', '931dbfc9-0737-452e-a287-9a5e51e265f8', 'fbf59389-8a1b-46da-8209-f11a84b179ac'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:42 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf 1073741824" returned: 0 in 0.529s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:42 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf Jul 17 05:26:42 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:42 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:42 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:42 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:26:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7880aa3b-3372-4bc2-adf8-3cf16acca86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366eaf26-0a18-4e71-8d30-47ae66761dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:26:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Volume volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf (0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf): created successfully Jul 17 05:26:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366eaf26-0a18-4e71-8d30-47ae66761dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:26:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Flow 'volume_create_manager' (64b22bc1-3d91-46fb-8273-6ec89fe3e43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:26:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-13aac42a-2eee-432e-9853-74b1d7e6a6fd tempest-ServersNegativeTestJSON-1259887026 None] Created volume successfully. Jul 17 05:26:43 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.425s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:43 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f5021264-3e20-4308-8add-bfbff9889a7a tempest-GroupsTest-1198065652 None] Delete group completed successfully. Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "cinder-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "cinder-quobyte-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-quobyte-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d1c119-3337-4815-892d-e0f4686a69dc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:45 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf Jul 17 05:26:45 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:45 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf" returned: 0 in 0.549s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:45 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf Jul 17 05:26:45 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:46 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-quobyte-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf" released by "delete_volume" :: held 0.960s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Created reservations ['873d91cb-93d0-4928-bfbb-1cc9f2ec15ee', 'c44b0579-bb0a-4348-9c6a-3e1d8586bc3f', 'bbf8f0a5-e67d-4917-bb6b-c5b96d23532f', '9e1c8259-bb55-4770-b989-4d146358a0b1'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:46 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:46 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:46 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.346s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Deleted volume successfully. Jul 17 05:26:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aefd187b-89ad-4663-b6bc-cea511e027bf tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-0b208d2d-1ad6-48c5-8144-2c3a6ebd3faf-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "cinder-da9e0956-207d-432d-92c4-6f7a85f4a813-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-da9e0956-207d-432d-92c4-6f7a85f4a813-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "cinder-quobyte-da9e0956-207d-432d-92c4-6f7a85f4a813" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:26:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-quobyte-da9e0956-207d-432d-92c4-6f7a85f4a813" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:26:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae5e02-0965-47ea-97cd-a331cc4c3c37]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:26:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:47 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 Jul 17 05:26:47 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:48 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813" returned: 0 in 0.482s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:48 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813 Jul 17 05:26:48 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:48 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da9e0956-207d-432d-92c4-6f7a85f4a813" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-quobyte-da9e0956-207d-432d-92c4-6f7a85f4a813" released by "delete_volume" :: held 0.940s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Created reservations ['f738315a-7530-4dad-9986-2994a0c31c12', 'd3f3dc4c-8c35-45d9-a072-7381c55fffa6', 'c47caf3e-b12b-4f67-9312-04ecbbe16a30', '8cdd562f-127a-4ba1-bb21-3db2cdd67910'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:48 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:48 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:49 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.548s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:49 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Deleted volume successfully. Jul 17 05:26:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-daad220b-996a-4144-b408-559942ff538d tempest-ServersNegativeTestJSON-1259887026 None] Lock "cinder-da9e0956-207d-432d-92c4-6f7a85f4a813-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:26:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0adb1a5f-fe61-4aec-aec5-e267a117717e tempest-GroupsV320Test-59356539 None] Group tempest-GroupsV320Test-Group-773271991: creating Jul 17 05:26:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0adb1a5f-fe61-4aec-aec5-e267a117717e tempest-GroupsV320Test-59356539 None] Group tempest-GroupsV320Test-Group-773271991: created successfully Jul 17 05:26:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0adb1a5f-fe61-4aec-aec5-e267a117717e tempest-GroupsV320Test-59356539 None] Create group completed successfully. Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Created reservations ['cbd55525-e5bb-43c8-b31e-397379944582'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:52 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:52 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:52 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-002eb2fd-8cac-4f37-bc08-924820111f46 tempest-GroupsV320Test-59356539 None] Delete group completed successfully. Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:26:56 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:26:56 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:26:56 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 8 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:26:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:27:02 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=73,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:27:02 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=64,cinder:UPDATE=81,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Flow 'volume_create_manager' (b6c78fb4-72e8-42ee-a60c-a1468b59b966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7a095a-f1d3-4e79-9937-a80514d8902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7a095a-f1d3-4e79-9937-a80514d8902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-23156130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151b7288-8265-4086-ab48-2f94cb688197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aa900422c04d9f92f901033b08a866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:04Z,use_quota=True,user_id='9439721117ed4a81a8f4f07f50d7d909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2208032e-ea74-4246-b5ed-acb73f8785db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2208032e-ea74-4246-b5ed-acb73f8785db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23fc29c-18cd-4d25-b62a-08987c5ede24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23fc29c-18cd-4d25-b62a-08987c5ede24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151b7288-8265-4086-ab48-2f94cb688197', 'volume_name': 'volume-151b7288-8265-4086-ab48-2f94cb688197', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b6ba0-d74f-47a2-9390-0b8489fddb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b6ba0-d74f-47a2-9390-0b8489fddb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742e296-a4ba-4417-85ef-eed94295ff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Volume 151b7288-8265-4086-ab48-2f94cb688197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151b7288-8265-4086-ab48-2f94cb688197', 'volume_size': 1} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-23156130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151b7288-8265-4086-ab48-2f94cb688197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aa900422c04d9f92f901033b08a866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:04Z,use_quota=True,user_id='9439721117ed4a81a8f4f07f50d7d909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Creating volume 151b7288-8265-4086-ab48-2f94cb688197 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:27:04 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:04 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 1073741824 Jul 17 05:27:04 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:04 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 1073741824" returned: 0 in 0.510s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:04 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 Jul 17 05:27:04 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:05 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:27:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742e296-a4ba-4417-85ef-eed94295ff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151b7288-8265-4086-ab48-2f94cb688197', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecd8ccf-4997-4b93-8e62-f61ce35ea1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Volume volume-151b7288-8265-4086-ab48-2f94cb688197 (151b7288-8265-4086-ab48-2f94cb688197): created successfully Jul 17 05:27:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecd8ccf-4997-4b93-8e62-f61ce35ea1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Flow 'volume_create_manager' (b6c78fb4-72e8-42ee-a60c-a1468b59b966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6cc83600-02d9-4113-bd06-08a30a67ff7e tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Created volume successfully. Jul 17 05:27:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Acquiring lock "cinder-151b7288-8265-4086-ab48-2f94cb688197-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "cinder-151b7288-8265-4086-ab48-2f94cb688197-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Acquiring lock "cinder-quobyte-151b7288-8265-4086-ab48-2f94cb688197" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "cinder-quobyte-151b7288-8265-4086-ab48-2f94cb688197" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb6f12-e89c-45dd-baea-da7779d0d110]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:27:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:07 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 Jul 17 05:27:07 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:08 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197" returned: 0 in 0.575s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:08 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197 Jul 17 05:27:08 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:08 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-151b7288-8265-4086-ab48-2f94cb688197" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "cinder-quobyte-151b7288-8265-4086-ab48-2f94cb688197" released by "delete_volume" :: held 0.977s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Created reservations ['bc426316-717c-4224-a24f-3da9b781f82d', '31e3d5fc-8463-47e6-b9a2-1791b5c8f3d5', 'f3fdd051-b55c-4c0a-8c71-d46381bf0e6c', 'ed60fb8a-d4d2-4a7e-af70-4a73d5464a5a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:08 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:27:08 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:09 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.452s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:09 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:27:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Deleted volume successfully. Jul 17 05:27:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4da09f58-74f1-4034-9b50-ea26194d4cc0 tempest-VolumeQuotasNegativeTestJSON-2140777695 None] Lock "cinder-151b7288-8265-4086-ab48-2f94cb688197-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Flow 'volume_create_manager' (0d2acd78-5208-4fb6-b00e-fb91769469dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d18a09-6ffe-4660-bd78-2ec513b492ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d18a09-6ffe-4660-bd78-2ec513b492ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1956991205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6411a510-35c5-4796-85e9-98056cbe8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ccb53b9d549119d42cfc2c71edabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:23Z,use_quota=True,user_id='61b3800e93ef4fe29edd408d1274d75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ec4b3d-cb24-4dc2-ba6c-90be71dd9497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ec4b3d-cb24-4dc2-ba6c-90be71dd9497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7c0f0c-bfae-4de4-bbda-8d0a845d60ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7c0f0c-bfae-4de4-bbda-8d0a845d60ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6411a510-35c5-4796-85e9-98056cbe8f7c', 'volume_name': 'volume-6411a510-35c5-4796-85e9-98056cbe8f7c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92938e34-0ec2-444f-aef3-502e67262a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92938e34-0ec2-444f-aef3-502e67262a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5f051-e784-4ce0-a789-7f73221e3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Volume 6411a510-35c5-4796-85e9-98056cbe8f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6411a510-35c5-4796-85e9-98056cbe8f7c', 'volume_size': 1} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1956991205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6411a510-35c5-4796-85e9-98056cbe8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ccb53b9d549119d42cfc2c71edabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:23Z,use_quota=True,user_id='61b3800e93ef4fe29edd408d1274d75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Creating volume 6411a510-35c5-4796-85e9-98056cbe8f7c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:27:23 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:27:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:23 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c 1073741824 Jul 17 05:27:23 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:24 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c 1073741824" returned: 0 in 0.868s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:24 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c Jul 17 05:27:24 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:25 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c" returned: 0 in 0.487s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5f051-e784-4ce0-a789-7f73221e3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6411a510-35c5-4796-85e9-98056cbe8f7c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacf5eb8-94a6-41d8-ae21-82a961180141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Volume volume-6411a510-35c5-4796-85e9-98056cbe8f7c (6411a510-35c5-4796-85e9-98056cbe8f7c): created successfully Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacf5eb8-94a6-41d8-ae21-82a961180141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Flow 'volume_create_manager' (0d2acd78-5208-4fb6-b00e-fb91769469dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fc34661b-f1eb-4b38-9f1f-bfba2636e739 tempest-VolumesServicesTestJSON-308735127 None] Created volume successfully. Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Flow 'volume_create_manager' (3463cf82-c05e-41be-afea-5b4d89222314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef2311a-5ae3-428e-b29f-762eaf699844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef2311a-5ae3-428e-b29f-762eaf699844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1233148952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2caaaa5e9234f729f28c811319fb4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:26Z,use_quota=True,user_id='d0db3d05316540b09b21ab14b2ebe5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9338613-14de-40e7-b050-e321bd56d175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9338613-14de-40e7-b050-e321bd56d175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc34a97-3b4f-4455-9402-5cc47411e344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc34a97-3b4f-4455-9402-5cc47411e344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e', 'volume_name': 'volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75401271-6467-422b-86d8-d4aea080ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75401271-6467-422b-86d8-d4aea080ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e05a8c-cc52-4871-a5b1-00222040214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Volume c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e', 'volume_size': 1} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1233148952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2caaaa5e9234f729f28c811319fb4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:26Z,use_quota=True,user_id='d0db3d05316540b09b21ab14b2ebe5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Creating volume c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:27:25 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:27:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:26 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e 1073741824 Jul 17 05:27:26 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Acquiring lock "cinder-6411a510-35c5-4796-85e9-98056cbe8f7c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Lock "cinder-6411a510-35c5-4796-85e9-98056cbe8f7c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Acquiring lock "cinder-quobyte-6411a510-35c5-4796-85e9-98056cbe8f7c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Lock "cinder-quobyte-6411a510-35c5-4796-85e9-98056cbe8f7c" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d821990c-5a12-4619-8df2-c50bc24d2af6]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:27:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:26 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c Jul 17 05:27:26 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:26 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e 1073741824" returned: 0 in 0.991s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:27 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e Jul 17 05:27:27 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:27 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c" returned: 0 in 0.819s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:27 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c Jul 17 05:27:27 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:27 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e" returned: 0 in 0.538s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e05a8c-cc52-4871-a5b1-00222040214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35c3d30-976a-43cf-8f8b-bf54238b37e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Volume volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e (c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e): created successfully Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35c3d30-976a-43cf-8f8b-bf54238b37e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Flow 'volume_create_manager' (3463cf82-c05e-41be-afea-5b4d89222314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f03dc55f-7757-409b-aad7-cd9694c06623 tempest-DeleteServersTestJSON-1871257951 None] Created volume successfully. Jul 17 05:27:27 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6411a510-35c5-4796-85e9-98056cbe8f7c" returned: 0 in 0.620s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Lock "cinder-quobyte-6411a510-35c5-4796-85e9-98056cbe8f7c" released by "delete_volume" :: held 1.509s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Created reservations ['695a481f-61dc-48c9-89c5-bd69f497f3c8', '03e467b4-f5c6-4fc0-a576-408feddbfa63', '0bcee990-018f-42c6-8242-8614b68bf6d6', '7f9d064a-43f5-4875-b127-0c1e1d366830'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:28 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:27:28 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:28 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.720s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:27:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Deleted volume successfully. Jul 17 05:27:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-78edf1d8-0ab3-410e-bb14-61e6819e8478 tempest-VolumesServicesTestJSON-308735127 None] Lock "cinder-6411a510-35c5-4796-85e9-98056cbe8f7c-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:32 devstack cinder-volume[87750]: WARNING py.warnings [req-d19add13-7a41-4960-a370-f9784ff918e8 req-4ec2f691-4b53-4d94-8a8a-8becef89d314 tempest-DeleteServersTestJSON-1871257951 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 17 05:27:32 devstack cinder-volume[87750]: .first() Jul 17 05:27:32 devstack cinder-volume[87750]: Jul 17 05:27:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d19add13-7a41-4960-a370-f9784ff918e8 req-4ec2f691-4b53-4d94-8a8a-8becef89d314 tempest-DeleteServersTestJSON-1871257951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d19add13-7a41-4960-a370-f9784ff918e8 req-4ec2f691-4b53-4d94-8a8a-8becef89d314 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d19add13-7a41-4960-a370-f9784ff918e8 req-4ec2f691-4b53-4d94-8a8a-8becef89d314 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-d19add13-7a41-4960-a370-f9784ff918e8 req-4ec2f691-4b53-4d94-8a8a-8becef89d314 tempest-DeleteServersTestJSON-1871257951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe7d27fd-3074-4070-9330-bff83ebf58e1', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:27:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-d19add13-7a41-4960-a370-f9784ff918e8 req-4ec2f691-4b53-4d94-8a8a-8becef89d314 tempest-DeleteServersTestJSON-1871257951 None] attachment_update completed successfully. Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Flow 'volume_create_manager' (1ad235f2-8ba4-46c5-816a-001fbfd87f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5828b89-e929-4765-9636-c96ec3a90a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5828b89-e929-4765-9636-c96ec3a90a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-306837054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071a3e28-b6ab-41e5-a173-8d73d2b6ade1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc1f53c46a14837abeca67359620dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:39Z,use_quota=True,user_id='2814d8ab16db4fc9a657875b7a0e011d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee24006-8286-4336-8f98-9e0df52d7b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee24006-8286-4336-8f98-9e0df52d7b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52b03ee-91eb-44af-975a-fb2367c51f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52b03ee-91eb-44af-975a-fb2367c51f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071a3e28-b6ab-41e5-a173-8d73d2b6ade1', 'volume_name': 'volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d8198e-17db-49ed-a780-5b8622a25d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d8198e-17db-49ed-a780-5b8622a25d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76758d4c-22f5-43ee-88bf-8a1da6de0111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Volume 071a3e28-b6ab-41e5-a173-8d73d2b6ade1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1', 'volume_size': 1} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-306837054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071a3e28-b6ab-41e5-a173-8d73d2b6ade1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc1f53c46a14837abeca67359620dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:39Z,use_quota=True,user_id='2814d8ab16db4fc9a657875b7a0e011d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Creating volume 071a3e28-b6ab-41e5-a173-8d73d2b6ade1 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:27:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:39 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 1073741824 Jul 17 05:27:39 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-94756cdf-63f0-47f1-aa1a-196d4810c0a9 req-d94adfc0-48f5-48fe-a287-73adeb227895 tempest-DeleteServersTestJSON-1871257951 None] Terminate volume connection completed successfully. Jul 17 05:27:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-94756cdf-63f0-47f1-aa1a-196d4810c0a9 req-d94adfc0-48f5-48fe-a287-73adeb227895 tempest-DeleteServersTestJSON-1871257951 None] Deleting attachment fe7d27fd-3074-4070-9330-bff83ebf58e1. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:27:40 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 1073741824" returned: 0 in 0.988s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:40 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 Jul 17 05:27:40 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:41 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:27:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76758d4c-22f5-43ee-88bf-8a1da6de0111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964368bc-0ba5-44db-884a-7276bc54ccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Volume volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 (071a3e28-b6ab-41e5-a173-8d73d2b6ade1): created successfully Jul 17 05:27:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964368bc-0ba5-44db-884a-7276bc54ccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Flow 'volume_create_manager' (1ad235f2-8ba4-46c5-816a-001fbfd87f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-046f0f8c-8a5e-4a67-b50e-820155d6d286 tempest-TaggedAttachmentsTest-1620630892 None] Created volume successfully. Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Acquiring lock "cinder-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Lock "cinder-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Acquiring lock "cinder-quobyte-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Lock "cinder-quobyte-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e" acquired by "delete_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97673c-71c3-47ce-8248-9910804bdae5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:42 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e Jul 17 05:27:42 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:42 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e" returned: 0 in 0.546s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:43 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e Jul 17 05:27:43 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:43 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Lock "cinder-quobyte-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e" released by "delete_volume" :: held 0.925s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Created reservations ['d82b109b-70fe-4807-8b25-ab8ce0bf62ce', '71cc1db6-e4ab-4a4a-a105-c9142b3e0e63', '923e637f-3b42-4513-beef-ddef7589bd65', '795d7fba-9cc1-4f98-8759-5799878ad950'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:43 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:27:43 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:44 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:44 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:27:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Deleted volume successfully. Jul 17 05:27:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8fa74c6-5bcf-41a9-b050-a19b4415b203 tempest-DeleteServersTestJSON-1871257951 None] Lock "cinder-c46b13ea-a0f5-4f2c-a29f-fc0ada045e9e-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Flow 'volume_create_manager' (789bb53f-d197-4384-800a-d47e5c403633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06b3dec-7192-4acf-9c9a-2b025339569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06b3dec-7192-4acf-9c9a-2b025339569f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-892061052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03d0daa-33ce-467c-a501-7c7430a1d789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47e5c73a034f0b96f2eaccbeceec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:50Z,use_quota=True,user_id='96719bc3bf784b8092b83608fec1d6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ea3042-4fc3-4b64-b096-bbf5ad41324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ea3042-4fc3-4b64-b096-bbf5ad41324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d0480-49e5-4ca7-8fae-2f64d2ac5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d0480-49e5-4ca7-8fae-2f64d2ac5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03d0daa-33ce-467c-a501-7c7430a1d789', 'volume_name': 'volume-e03d0daa-33ce-467c-a501-7c7430a1d789', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c493e977-f9b7-49ae-9af9-0f690e754b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c493e977-f9b7-49ae-9af9-0f690e754b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c59a79-1976-4e58-a111-054e72530aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Volume e03d0daa-33ce-467c-a501-7c7430a1d789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03d0daa-33ce-467c-a501-7c7430a1d789', 'volume_size': 1} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-892061052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03d0daa-33ce-467c-a501-7c7430a1d789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47e5c73a034f0b96f2eaccbeceec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:27:50Z,use_quota=True,user_id='96719bc3bf784b8092b83608fec1d6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Creating volume e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:27:50 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:50 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 1073741824 Jul 17 05:27:50 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:50 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 1073741824" returned: 0 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:50 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 Jul 17 05:27:50 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:50 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789" returned: 0 in 0.296s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c59a79-1976-4e58-a111-054e72530aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03d0daa-33ce-467c-a501-7c7430a1d789', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d91a389-c85f-49fa-98b4-d10b05542eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:27:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Volume volume-e03d0daa-33ce-467c-a501-7c7430a1d789 (e03d0daa-33ce-467c-a501-7c7430a1d789): created successfully Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d91a389-c85f-49fa-98b4-d10b05542eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:27:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Flow 'volume_create_manager' (789bb53f-d197-4384-800a-d47e5c403633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:27:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3b0654ee-4ffc-49db-bfb3-98f319657de4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Created volume successfully. Jul 17 05:27:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Creating offline snapshot 6e3e5d30-7f14-4d02-8853-957f7eaf2f39 of volume e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:27:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bf1186-0d9d-48e3-b031-0ac77dfeb30a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:27:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:52 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 Jul 17 05:27:52 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:53 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789" returned: 0 in 0.581s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:53 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 1G Jul 17 05:27:53 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:53 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 1G" returned: 0 in 0.408s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03d0daa-33ce-467c-a501-7c7430a1d789 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:53 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03d0daa-33ce-467c-a501-7c7430a1d789 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 Jul 17 05:27:53 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:53 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03d0daa-33ce-467c-a501-7c7430a1d789 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39" returned: 0 in 0.453s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:53 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 is being set with open permissions: ugo+rw Jul 17 05:27:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:53 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 Jul 17 05:27:53 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:54 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:54 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.info Jul 17 05:27:54 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:54 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.info" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:54 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.info is being set with open permissions: ugo+rw Jul 17 05:27:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:54 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.info Jul 17 05:27:54 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:54 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.info" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.599s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-35c1b287-f191-4e9b-b7f0-159604e5bf20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Create snapshot completed successfully Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "cinder-6e3e5d30-7f14-4d02-8853-957f7eaf2f39-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-6e3e5d30-7f14-4d02-8853-957f7eaf2f39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "cinder-quobyte-e03d0daa-33ce-467c-a501-7c7430a1d789" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:56 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:27:56 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-quobyte-e03d0daa-33ce-467c-a501-7c7430a1d789" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "cinder-quobyte-6e3e5d30-7f14-4d02-8853-957f7eaf2f39" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-quobyte-6e3e5d30-7f14-4d02-8853-957f7eaf2f39" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Deleting offline snapshot 6e3e5d30-7f14-4d02-8853-957f7eaf2f39 of volume e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] snapshot_file for this snap is: volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[594aa58a-19a3-492b-97ce-0ba8dc961151]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:56 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 Jul 17 05:27:56 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:56 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.528s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 8 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:27:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:27:57 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39" returned: 0 in 0.811s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e03d0daa-33ce-467c-a501-7c7430a1d789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:27:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4347628f-06cd-43fa-8951-82cc3fa382d9]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:27:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:57 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 Jul 17 05:27:57 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:57 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789" returned: 0 in 0.551s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:57 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 Jul 17 05:27:57 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:58 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39" returned: 0 in 0.747s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:58 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39 Jul 17 05:27:58 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:27:59 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789.6e3e5d30-7f14-4d02-8853-957f7eaf2f39" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-quobyte-6e3e5d30-7f14-4d02-8853-957f7eaf2f39" released by "_delete_snapshot" :: held 2.667s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-quobyte-e03d0daa-33ce-467c-a501-7c7430a1d789" released by "delete_snapshot" :: held 2.717s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:59 devstack cinder-volume[87750]: WARNING cinder.quota [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Created reservations ['22fd3df9-db7b-4e9a-ae14-7419dbedecbd', 'fb8b5191-8c9d-4835-949c-31a0a1170de2', 'cbe1e59d-c1dc-4bd7-8244-1ef7205409ac', 'd5cf220b-5705-41e0-9a28-9fd7f97115f7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:27:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Delete snapshot completed successfully. Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ed3e62d-475f-4da1-bbc2-3c37e91de6aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-6e3e5d30-7f14-4d02-8853-957f7eaf2f39-delete_snapshot" released by "delete_snapshot" :: held 2.948s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "cinder-e03d0daa-33ce-467c-a501-7c7430a1d789-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-e03d0daa-33ce-467c-a501-7c7430a1d789-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "cinder-quobyte-e03d0daa-33ce-467c-a501-7c7430a1d789" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-quobyte-e03d0daa-33ce-467c-a501-7c7430a1d789" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e067875d-e3d6-4d27-9148-71f8a2630ff6]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:27:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:27:59 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 Jul 17 05:28:00 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:00 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:00 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789 Jul 17 05:28:00 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:00 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e03d0daa-33ce-467c-a501-7c7430a1d789" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-quobyte-e03d0daa-33ce-467c-a501-7c7430a1d789" released by "delete_volume" :: held 0.811s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Created reservations ['ee1104f9-43f2-4ea0-81ad-c2dcaef510ed', '161d3519-ef12-4647-903a-f52003417548', '5586b181-fc57-4d45-bb6b-8ad848ba7f02', 'd2583ca8-8d7e-451e-8947-4a7a3b058deb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:00 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:28:00 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:01 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:28:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Deleted volume successfully. Jul 17 05:28:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d0ab243-5bdc-46d5-91f3-7c2d9a987e60 tempest-VolumeSnapshotQuotasNegativeTestJSON-1486783163 None] Lock "cinder-e03d0daa-33ce-467c-a501-7c7430a1d789-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Flow 'volume_create_manager' (6f416bc3-d41c-4f49-8a78-e056c4a7c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1b6678-c3c6-4703-9932-ebd777494cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1b6678-c3c6-4703-9932-ebd777494cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1384770011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e588939-92d0-470a-8484-074cf44ac0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476c952046384481bea875434911e330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:02Z,use_quota=True,user_id='41ce6d1d286d4107a849132dd2c913d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15066784-b7b9-476a-9bfa-3eb79a3bd800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15066784-b7b9-476a-9bfa-3eb79a3bd800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f190f6dd-d20a-461e-96a3-5991666b489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f190f6dd-d20a-461e-96a3-5991666b489a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e588939-92d0-470a-8484-074cf44ac0e2', 'volume_name': 'volume-9e588939-92d0-470a-8484-074cf44ac0e2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c07251-b90a-4a32-871a-58d69a7ccabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c07251-b90a-4a32-871a-58d69a7ccabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c43442c-3162-412c-96e4-e76c737e04bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Volume 9e588939-92d0-470a-8484-074cf44ac0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e588939-92d0-470a-8484-074cf44ac0e2', 'volume_size': 1} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1384770011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e588939-92d0-470a-8484-074cf44ac0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476c952046384481bea875434911e330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:02Z,use_quota=True,user_id='41ce6d1d286d4107a849132dd2c913d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Creating volume 9e588939-92d0-470a-8484-074cf44ac0e2 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:28:02 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:28:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:02 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 1073741824 Jul 17 05:28:02 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:03 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 1073741824" returned: 0 in 0.732s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:03 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 Jul 17 05:28:03 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:03 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c43442c-3162-412c-96e4-e76c737e04bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e588939-92d0-470a-8484-074cf44ac0e2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9713fef9-b689-478a-a260-a8ac1a283f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Volume volume-9e588939-92d0-470a-8484-074cf44ac0e2 (9e588939-92d0-470a-8484-074cf44ac0e2): created successfully Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9713fef9-b689-478a-a260-a8ac1a283f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Flow 'volume_create_manager' (6f416bc3-d41c-4f49-8a78-e056c4a7c050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ead3d43a-aeb0-44c8-b1c1-37d6678569d0 tempest-AttachVolumeShelveTestJSON-1100771202 None] Created volume successfully. Jul 17 05:28:13 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=44,cinder:UPDATE=46,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:28:13 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=39,cinder:UPDATE=49,cinder:DELETE=7,cinder:INSERT=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Flow 'volume_create_manager' (27530b52-e425-472b-a58a-211b73c379d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c1a526-cbe4-4a72-882d-839ed1c4d97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c1a526-cbe4-4a72-882d-839ed1c4d97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-485702977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b33885-55bb-47c6-97d7-1396cb303d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115e06a528ba49f5b2b45c6921860a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:25Z,use_quota=True,user_id='8aff9c5474724d998331135fdb91e198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93f66c3-3971-435d-b075-d028e3f14526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93f66c3-3971-435d-b075-d028e3f14526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c79286-effc-4c7e-ae37-1e7a7f7c524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:24 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:28:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-09b50825-e577-4229-957b-72949e7bf5c2 req-2a63b42b-7558-43e3-b7a7-2fc3bec70529 tempest-AttachVolumeShelveTestJSON-1100771202 None] No connector for attachment d9f95af8-a23e-4894-b813-7e36ffce8223; skipping storage backend terminate_connection call. {{(pid=87750) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 17 05:28:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-09b50825-e577-4229-957b-72949e7bf5c2 req-2a63b42b-7558-43e3-b7a7-2fc3bec70529 tempest-AttachVolumeShelveTestJSON-1100771202 None] Deleting attachment d9f95af8-a23e-4894-b813-7e36ffce8223. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:28:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c79286-effc-4c7e-ae37-1e7a7f7c524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29b33885-55bb-47c6-97d7-1396cb303d15', 'volume_name': 'volume-29b33885-55bb-47c6-97d7-1396cb303d15', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af90b852-2552-445b-b7bd-14b5df1dac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af90b852-2552-445b-b7bd-14b5df1dac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6257ae-a974-42a5-8c22-b188b647733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Volume 29b33885-55bb-47c6-97d7-1396cb303d15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29b33885-55bb-47c6-97d7-1396cb303d15', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 05:28:25 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Trying to clone 29b33885-55bb-47c6-97d7-1396cb303d15 from image 574080f6-40fa-4386-bd5c-892273b66d56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:28:26 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:28:26 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Image download 20.69 MB at 20.69 MB/s Jul 17 05:28:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[810959a6-c9b3-48a7-b755-5d3e5752bba2]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:26 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD Jul 17 05:28:26 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:27 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:27 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 is fetched for user 8aff9c5474724d998331135fdb91e198. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:28:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b2ffcc-c210-4332-b220-2fb2fb13a199]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:27 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD Jul 17 05:28:27 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:28 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD" returned: 0 in 0.674s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-485702977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b33885-55bb-47c6-97d7-1396cb303d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115e06a528ba49f5b2b45c6921860a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:25Z,use_quota=True,user_id='8aff9c5474724d998331135fdb91e198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Creating volume 29b33885-55bb-47c6-97d7-1396cb303d15 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:28:28 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:28:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:28 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 1073741824 Jul 17 05:28:28 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:29 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 1073741824" returned: 0 in 0.824s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:29 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 Jul 17 05:28:29 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:30 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15" returned: 0 in 1.022s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:28:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:30 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Attempting download of 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume 29b33885-55bb-47c6-97d7-1396cb303d15. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:28:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bb3f65-775b-4824-802e-aff760fd9597]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_m_e9h0u1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:30 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_m_e9h0u1 Jul 17 05:28:30 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:31 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_m_e9h0u1" returned: 0 in 0.644s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_m_e9h0u1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:31 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_m_e9h0u1 Jul 17 05:28:31 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:31 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_m_e9h0u1" returned: 1 in 0.682s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_m_e9h0u1' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:28:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b55e6b1-abaf-45cf-b268-5d37ba435f2d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:32 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD Jul 17 05:28:32 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:33 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD" returned: 0 in 1.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:33 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] 574080f6-40fa-4386-bd5c-892273b66d56 was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:28:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:33 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 Jul 17 05:28:33 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7441a248-c72c-46a6-a8db-080835fa3873 req-d24228f7-c760-49fa-b1b1-96dc83e217d3 tempest-TaggedAttachmentsTest-1620630892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7441a248-c72c-46a6-a8db-080835fa3873 req-d24228f7-c760-49fa-b1b1-96dc83e217d3 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7441a248-c72c-46a6-a8db-080835fa3873 req-d24228f7-c760-49fa-b1b1-96dc83e217d3 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-7441a248-c72c-46a6-a8db-080835fa3873 req-d24228f7-c760-49fa-b1b1-96dc83e217d3 tempest-TaggedAttachmentsTest-1620630892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ece36244-4a8f-4e07-a89e-b1acbda82c41', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:28:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-7441a248-c72c-46a6-a8db-080835fa3873 req-d24228f7-c760-49fa-b1b1-96dc83e217d3 tempest-TaggedAttachmentsTest-1620630892 None] attachment_update completed successfully. Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Flow 'volume_create_manager' (4ca443df-887b-4f40-a1b3-f731265ce147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2ef20f-e7e4-4ff3-9ec5-3168ac970ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2ef20f-e7e4-4ff3-9ec5-3168ac970ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-328777683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a88d5fb-8e3d-4fa1-9ad8-727fa2070767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47f86d25789446fbd9e082a53894e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:37Z,use_quota=True,user_id='4498770f9fe5463fa5aacace83d9e984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a67d0d9-a970-4e81-9bcf-0b344e5b0539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a67d0d9-a970-4e81-9bcf-0b344e5b0539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e17ca-45ed-45fc-b526-a0537abc403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e17ca-45ed-45fc-b526-a0537abc403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a88d5fb-8e3d-4fa1-9ad8-727fa2070767', 'volume_name': 'volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dabf035c-4589-4d07-af3f-7f70f6ff50f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dabf035c-4589-4d07-af3f-7f70f6ff50f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c6fe00-0be0-4317-9195-dc81525b4657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Volume 5a88d5fb-8e3d-4fa1-9ad8-727fa2070767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767', 'volume_size': 1} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-328777683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a88d5fb-8e3d-4fa1-9ad8-727fa2070767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47f86d25789446fbd9e082a53894e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:37Z,use_quota=True,user_id='4498770f9fe5463fa5aacace83d9e984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Creating volume 5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:37 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:28:37 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15" returned: 0 in 3.917s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_njrf3jsmdevstack@QuobyteHD, size 112.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:28:37 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Converted 112.00 MB image at 28.57 MB/s Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:37 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 1G Jul 17 05:28:37 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:37 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 1073741824 Jul 17 05:28:37 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:37 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 1G" returned: 0 in 0.771s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Downloaded image 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume 29b33885-55bb-47c6-97d7-1396cb303d15 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 for user 8aff9c5474724d998331135fdb91e198 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Marking volume 29b33885-55bb-47c6-97d7-1396cb303d15 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Copying metadata from image 574080f6-40fa-4386-bd5c-892273b66d56 to 29b33885-55bb-47c6-97d7-1396cb303d15. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:28:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Creating volume glance metadata for volume 29b33885-55bb-47c6-97d7-1396cb303d15 backed by image 574080f6-40fa-4386-bd5c-892273b66d56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:28:38 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 1073741824" returned: 0 in 1.069s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6257ae-a974-42a5-8c22-b188b647733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b33885-55bb-47c6-97d7-1396cb303d15', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8959d7d7-56db-4d59-a7d7-434d8fec9e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Volume volume-29b33885-55bb-47c6-97d7-1396cb303d15 (29b33885-55bb-47c6-97d7-1396cb303d15): created successfully Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8959d7d7-56db-4d59-a7d7-434d8fec9e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Flow 'volume_create_manager' (27530b52-e425-472b-a58a-211b73c379d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6c29e4cd-078e-40a2-bca1-3a55cd7f680b tempest-VolumesImageMetadata-572705437 None] Created volume successfully. Jul 17 05:28:38 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 Jul 17 05:28:38 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:38 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767" returned: 0 in 0.624s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:28:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c6fe00-0be0-4317-9195-dc81525b4657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f56a7eb-74e6-4bc9-a87c-562a9bc56465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Volume volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 (5a88d5fb-8e3d-4fa1-9ad8-727fa2070767): created successfully Jul 17 05:28:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f56a7eb-74e6-4bc9-a87c-562a9bc56465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Flow 'volume_create_manager' (4ca443df-887b-4f40-a1b3-f731265ce147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-69b70f9f-2dca-4bbf-ad78-67e5e19e779f tempest-ServerRescueNegativeTestJSON-2065616453 None] Created volume successfully. Jul 17 05:28:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Acquiring lock "cinder-29b33885-55bb-47c6-97d7-1396cb303d15-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Lock "cinder-29b33885-55bb-47c6-97d7-1396cb303d15-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Acquiring lock "cinder-quobyte-29b33885-55bb-47c6-97d7-1396cb303d15" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3b9736cf-6ad8-4d7d-a969-6090a0e3f7e4 req-a1f958be-a2ef-4011-afd2-3830b6caf4bb tempest-TaggedAttachmentsTest-1620630892 None] Terminate volume connection completed successfully. Jul 17 05:28:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b9736cf-6ad8-4d7d-a969-6090a0e3f7e4 req-a1f958be-a2ef-4011-afd2-3830b6caf4bb tempest-TaggedAttachmentsTest-1620630892 None] Deleting attachment ece36244-4a8f-4e07-a89e-b1acbda82c41. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:28:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Lock "cinder-quobyte-29b33885-55bb-47c6-97d7-1396cb303d15" acquired by "delete_volume" :: waited 0.056s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df4e6a-3ad1-42c3-9a54-9de2cc4d1c70]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:40 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 Jul 17 05:28:40 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15" returned: 0 in 0.947s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:41 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:41 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15 Jul 17 05:28:41 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:42 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-29b33885-55bb-47c6-97d7-1396cb303d15" returned: 0 in 0.935s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Lock "cinder-quobyte-29b33885-55bb-47c6-97d7-1396cb303d15" released by "delete_volume" :: held 2.023s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Created reservations ['5a976d84-9586-4495-b46c-3347ae58d48f', '95e69414-37b5-4d65-a128-0d649b35ae08', '0587e198-0e82-4328-bd03-3a41e1cc5bad', '4c3cad6f-c579-48d0-8002-12ff44caa6b1'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:42 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:28:42 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:43 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.711s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:43 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:28:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Deleted volume successfully. Jul 17 05:28:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-51ced7b1-04cc-4a06-adfb-512c7f9ac287 tempest-VolumesImageMetadata-572705437 None] Lock "cinder-29b33885-55bb-47c6-97d7-1396cb303d15-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:52 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=25,cinder:UPDATE=16,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:28:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Flow 'volume_create_manager' (f551dd44-6ff1-436d-a937-971d1e3cb3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6478782b-602d-4ba1-b132-a70e2e3e63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6478782b-602d-4ba1-b132-a70e2e3e63db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-919741205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17333f27e2274c47b27437927b8cb1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:53Z,use_quota=True,user_id='03fe923e30274df6bd3130029b704da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6a4776-f8c4-477b-a34e-35f77330a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6a4776-f8c4-477b-a34e-35f77330a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d473f189-83f4-469d-b461-132c54048040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d473f189-83f4-469d-b461-132c54048040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e', 'volume_name': 'volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6acd66d-4295-48e0-a8b9-886bc2649d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6acd66d-4295-48e0-a8b9-886bc2649d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bfa831-75a8-46d2-aa4f-82730bc4a5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Volume 2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e', 'volume_size': 1} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-919741205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17333f27e2274c47b27437927b8cb1a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:28:53Z,use_quota=True,user_id='03fe923e30274df6bd3130029b704da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Creating volume 2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:28:53 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:53 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e 1073741824 Jul 17 05:28:53 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:53 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e 1073741824" returned: 0 in 0.672s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:53 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e Jul 17 05:28:53 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:54 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e" returned: 0 in 0.532s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:28:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bfa831-75a8-46d2-aa4f-82730bc4a5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ec0351-efdc-4493-81d2-b81b89dc63a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:28:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Volume volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e (2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e): created successfully Jul 17 05:28:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ec0351-efdc-4493-81d2-b81b89dc63a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:28:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Flow 'volume_create_manager' (f551dd44-6ff1-436d-a937-971d1e3cb3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:28:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7a2ecce0-6f4a-46d0-81f7-745ed3977283 tempest-AbsoluteLimitsTests-2004358665 None] Created volume successfully. Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Acquiring lock "cinder-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "cinder-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Acquiring lock "cinder-quobyte-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "cinder-quobyte-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Acquiring lock "cinder-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc5fde6-6cbf-4615-bc29-4339b0fd5214]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Lock "cinder-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Acquiring lock "cinder-quobyte-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Lock "cinder-quobyte-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e1f5b4-6a71-43bc-9157-e9636c1434ea]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:55 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 Jul 17 05:28:55 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:55 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e Jul 17 05:28:55 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:56 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:28:56 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:56 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e" returned: 0 in 0.844s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:56 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767" returned: 0 in 1.179s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:56 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e Jul 17 05:28:56 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:56 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767 Jul 17 05:28:56 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:57 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.834s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Acquiring lock "cinder-071a3e28-b6ab-41e5-a173-8d73d2b6ade1-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:57 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767" returned: 0 in 0.776s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:57 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "cinder-quobyte-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767" released by "delete_volume" :: held 2.077s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Lock "cinder-071a3e28-b6ab-41e5-a173-8d73d2b6ade1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e" returned: 0 in 0.933s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Lock "cinder-quobyte-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e" released by "delete_volume" :: held 1.922s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Acquiring lock "cinder-quobyte-071a3e28-b6ab-41e5-a173-8d73d2b6ade1" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Lock "cinder-quobyte-071a3e28-b6ab-41e5-a173-8d73d2b6ade1" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1a212d-2a27-43de-a740-8c9fc343451e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:57 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Created reservations ['8f0cf913-8ce4-4d58-ab6a-817fc22a6489', '6b9a0ee2-0e9f-4ea3-affa-60d2549fd2e4', 'ca8a45e0-1197-407f-8adf-600d1e14d3b8', '519fda63-0d9f-41ad-944d-825e534f77ee'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Created reservations ['de96580f-35c5-4b7c-8a42-215563fce38a', 'b28e9ac5-61a7-4d8e-83c1-d35fe4032794', '0b90b83d-a3ae-4f37-9729-acdc55820154', 'df1f31c3-f337-4399-9a39-6c83022d596d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:28:58 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 Jul 17 05:28:58 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:58 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:28:58 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:58 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:28:58 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:58 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1" returned: 0 in 0.676s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:58 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.518s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:28:58 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1 Jul 17 05:28:58 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:28:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Deleted volume successfully. Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3489eee-468d-4d39-a7c2-bdc99a6ce605 tempest-ServerRescueNegativeTestJSON-2065616453 None] Lock "cinder-5a88d5fb-8e3d-4fa1-9ad8-727fa2070767-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:58 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:28:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Deleted volume successfully. Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ee2365f9-1a7b-4ec2-a281-a0e40b6a2026 tempest-AbsoluteLimitsTests-2004358665 None] Lock "cinder-2dc0da5b-04af-4aa9-bfcc-7f95c7b4480e-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:58 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Jul 17 05:28:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-071a3e28-b6ab-41e5-a173-8d73d2b6ade1" returned: 0 in 0.423s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Lock "cinder-quobyte-071a3e28-b6ab-41e5-a173-8d73d2b6ade1" released by "delete_volume" :: held 1.192s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Created reservations ['5c960832-8947-4454-bfd6-b3941314ef28', '45681d44-8ab5-4e95-935d-8009f03097ea', 'fc5bb8bb-52ed-48cf-8818-52a99530d886', '09867a19-8805-4453-a293-06bcf72dc154'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:28:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:28:59 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:28:59 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:00 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.868s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:00 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Deleted volume successfully. Jul 17 05:29:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-447dccde-c21b-4407-aed2-ae607a8bcbf4 tempest-TaggedAttachmentsTest-1620630892 None] Lock "cinder-071a3e28-b6ab-41e5-a173-8d73d2b6ade1-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Flow 'volume_create_manager' (302dd986-302a-4791-935b-8176f410ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06dac01-5723-4d4e-8d39-8270c1fa2fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06dac01-5723-4d4e-8d39-8270c1fa2fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1620160550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41caf02-cc39-42a4-88a0-407998d47411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4308914668455295f80e07727e4dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:08Z,use_quota=True,user_id='bac93971a6fd46c9849ef6c0b110e1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c0a195-e5a9-48e8-96a3-b212ae6f29d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c0a195-e5a9-48e8-96a3-b212ae6f29d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c0cc8b-c641-4590-97ec-4e14c30145cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c0cc8b-c641-4590-97ec-4e14c30145cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41caf02-cc39-42a4-88a0-407998d47411', 'volume_name': 'volume-b41caf02-cc39-42a4-88a0-407998d47411', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5d2621-86e5-44bb-89b5-f56ba3cb3c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5d2621-86e5-44bb-89b5-f56ba3cb3c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3aa00a-df87-4731-a207-eb9b7c17c31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Volume b41caf02-cc39-42a4-88a0-407998d47411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41caf02-cc39-42a4-88a0-407998d47411', 'volume_size': 1} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1620160550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41caf02-cc39-42a4-88a0-407998d47411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4308914668455295f80e07727e4dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:08Z,use_quota=True,user_id='bac93971a6fd46c9849ef6c0b110e1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Creating volume b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:08 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:08 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 1073741824 Jul 17 05:29:08 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:08 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 1073741824" returned: 0 in 0.437s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:08 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 Jul 17 05:29:08 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:09 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:29:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3aa00a-df87-4731-a207-eb9b7c17c31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41caf02-cc39-42a4-88a0-407998d47411', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fa78f3-4612-4188-8917-2b89cdfa7275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Volume volume-b41caf02-cc39-42a4-88a0-407998d47411 (b41caf02-cc39-42a4-88a0-407998d47411): created successfully Jul 17 05:29:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fa78f3-4612-4188-8917-2b89cdfa7275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Flow 'volume_create_manager' (302dd986-302a-4791-935b-8176f410ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4091caa1-f744-46fb-9b62-d90d00bdd086 tempest-VolumesDeleteCascade-894014668 None] Created volume successfully. Jul 17 05:29:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Creating offline snapshot e6f2c14a-b421-4d1e-962c-268f97745b14 of volume b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:29:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb7b16-e8ad-49d0-937b-c6b27b2530d8]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:10 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 Jul 17 05:29:10 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:10 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:11 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 1G Jul 17 05:29:11 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:11 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 1G" returned: 0 in 0.612s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41caf02-cc39-42a4-88a0-407998d47411 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:11 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41caf02-cc39-42a4-88a0-407998d47411 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 Jul 17 05:29:11 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:12 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41caf02-cc39-42a4-88a0-407998d47411 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14" returned: 0 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:12 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 is being set with open permissions: ugo+rw Jul 17 05:29:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:12 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 Jul 17 05:29:12 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:12 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:12 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.info Jul 17 05:29:12 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:12 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.info" returned: 0 in 0.438s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:12 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.info is being set with open permissions: ugo+rw Jul 17 05:29:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:12 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.info Jul 17 05:29:12 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:13 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.info" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f726a0e1-1381-4e0c-8cca-4f098b3a6e55 tempest-VolumesDeleteCascade-894014668 None] Create snapshot completed successfully Jul 17 05:29:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Creating offline snapshot 33a164b7-169f-4390-a953-54f2f6a1abaf of volume b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:29:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefc28c7-968d-4129-8684-4c4fc670508e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:14 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 Jul 17 05:29:14 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:14 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14" returned: 0 in 0.381s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41caf02-cc39-42a4-88a0-407998d47411(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:29:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:14 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf 1G Jul 17 05:29:14 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:14 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf 1G" returned: 0 in 0.523s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:14 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf Jul 17 05:29:14 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:15 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:15 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf is being set with open permissions: ugo+rw Jul 17 05:29:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:15 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf Jul 17 05:29:15 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:15 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1467e314-4675-4690-8329-b5a888dd3b26 tempest-VolumesDeleteCascade-894014668 None] Create snapshot completed successfully Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-b41caf02-cc39-42a4-88a0-407998d47411-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-b41caf02-cc39-42a4-88a0-407998d47411-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Performing cascade delete. {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-33a164b7-169f-4390-a953-54f2f6a1abaf-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-33a164b7-169f-4390-a953-54f2f6a1abaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-33a164b7-169f-4390-a953-54f2f6a1abaf" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-33a164b7-169f-4390-a953-54f2f6a1abaf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Deleting offline snapshot 33a164b7-169f-4390-a953-54f2f6a1abaf of volume b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] snapshot_file for this snap is: volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86fd19-f7ae-4b7e-ba3e-441d9e9bd1c5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Flow 'volume_create_manager' (9bbc7f21-40ec-4df0-ad1b-2f2cf093347f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907e41c2-8186-4942-b80c-adb205b9de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907e41c2-8186-4942-b80c-adb205b9de6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548959674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a58fa20-79a6-44df-9f6d-65c837bf3cee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14877b34794349a6b980d9b3cca0506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:17Z,use_quota=True,user_id='0c5ce09929104b8f8fd30c15ea4d9376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9ec1c5-4fa1-47f3-bdb3-b8a7ea656f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9ec1c5-4fa1-47f3-bdb3-b8a7ea656f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9729491-a561-464a-be03-6627cdd89291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9729491-a561-464a-be03-6627cdd89291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a58fa20-79a6-44df-9f6d-65c837bf3cee', 'volume_name': 'volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea7c76c-9cdf-46a2-a817-4998d701f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea7c76c-9cdf-46a2-a817-4998d701f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0aa14a-b349-4ac8-9483-1b6a9fb645c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Volume 3a58fa20-79a6-44df-9f6d-65c837bf3cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee', 'volume_size': 1} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548959674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a58fa20-79a6-44df-9f6d-65c837bf3cee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14877b34794349a6b980d9b3cca0506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:17Z,use_quota=True,user_id='0c5ce09929104b8f8fd30c15ea4d9376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Creating volume 3a58fa20-79a6-44df-9f6d-65c837bf3cee {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:16 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:29:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:16 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf Jul 17 05:29:16 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:16 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee 1073741824 Jul 17 05:29:16 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:17 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf" returned: 0 in 0.545s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41caf02-cc39-42a4-88a0-407998d47411(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c3cb0-710e-4a32-8d27-51fb9c31d1e6]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:17 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 Jul 17 05:29:17 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:17 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee 1073741824" returned: 0 in 0.773s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:17 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee Jul 17 05:29:17 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:17 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14" returned: 0 in 0.643s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41caf02-cc39-42a4-88a0-407998d47411(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:17 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf Jul 17 05:29:17 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:17 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:29:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0aa14a-b349-4ac8-9483-1b6a9fb645c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c81c45-c20b-4997-a099-b032a7c3579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Volume volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee (3a58fa20-79a6-44df-9f6d-65c837bf3cee): created successfully Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c81c45-c20b-4997-a099-b032a7c3579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Flow 'volume_create_manager' (9bbc7f21-40ec-4df0-ad1b-2f2cf093347f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b049abad-8176-4ef5-af0d-d29791975ce6 tempest-VolumesTestJSON-2090208706 None] Created volume successfully. Jul 17 05:29:18 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf" returned: 0 in 0.424s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:18 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf Jul 17 05:29:18 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:18 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.33a164b7-169f-4390-a953-54f2f6a1abaf" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-33a164b7-169f-4390-a953-54f2f6a1abaf" released by "_delete_snapshot" :: held 2.030s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" released by "delete_snapshot" :: held 2.067s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Created reservations ['ec4bb8e7-23ab-4917-8772-322622bf84ba', '4e3b9fce-677a-497a-a4ed-a87cc74d8979', 'ae9630d1-8db1-4d52-a258-e5d9a79f3de8', '1c77ef74-d98e-438f-ab4c-94f41a80603d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Delete snapshot completed successfully. Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-33a164b7-169f-4390-a953-54f2f6a1abaf-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-e6f2c14a-b421-4d1e-962c-268f97745b14-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-e6f2c14a-b421-4d1e-962c-268f97745b14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-e6f2c14a-b421-4d1e-962c-268f97745b14" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-e6f2c14a-b421-4d1e-962c-268f97745b14" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Deleting offline snapshot e6f2c14a-b421-4d1e-962c-268f97745b14 of volume b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] snapshot_file for this snap is: volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[84392a5f-2a4c-468a-b416-8874b9c20644]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:19 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 Jul 17 05:29:19 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Flow 'volume_create_manager' (714e252a-736e-4084-a5d2-c6d37190dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc16cbb8-a609-4d85-ac33-cfda22e79e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc16cbb8-a609-4d85-ac33-cfda22e79e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-275931967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b01b87-cf2f-4874-8b5b-4c66a3f969f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14877b34794349a6b980d9b3cca0506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:19Z,use_quota=True,user_id='0c5ce09929104b8f8fd30c15ea4d9376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e63346-9610-4492-bd08-e758e82ed3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e63346-9610-4492-bd08-e758e82ed3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9b9065-002a-4c9c-98c0-2da513de58c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9b9065-002a-4c9c-98c0-2da513de58c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b01b87-cf2f-4874-8b5b-4c66a3f969f2', 'volume_name': 'volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339aaed1-50ba-49b8-967a-0b9f4da5f2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339aaed1-50ba-49b8-967a-0b9f4da5f2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874a402e-3cfc-4b69-b492-3cca815357ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:19 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Volume e6b01b87-cf2f-4874-8b5b-4c66a3f969f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2', 'volume_size': 1} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-275931967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b01b87-cf2f-4874-8b5b-4c66a3f969f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14877b34794349a6b980d9b3cca0506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:19Z,use_quota=True,user_id='0c5ce09929104b8f8fd30c15ea4d9376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Creating volume e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:19 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b41caf02-cc39-42a4-88a0-407998d47411(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:29:19 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 1073741824 Jul 17 05:29:19 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f94e800-eed9-4e90-be95-8fbbc58dc486]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:19 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 Jul 17 05:29:19 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Acquiring lock "cinder-9e588939-92d0-470a-8484-074cf44ac0e2-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "cinder-9e588939-92d0-470a-8484-074cf44ac0e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Acquiring lock "cinder-quobyte-9e588939-92d0-470a-8484-074cf44ac0e2" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "cinder-quobyte-9e588939-92d0-470a-8484-074cf44ac0e2" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e89c339-845d-4fdd-b454-ceb737e919d4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:20 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411" returned: 0 in 0.466s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:20 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 Jul 17 05:29:20 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:20 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 1073741824" returned: 0 in 0.610s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:20 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 Jul 17 05:29:20 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:20 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 Jul 17 05:29:20 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:20 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2" returned: 0 in 0.523s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:20 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:20 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2 Jul 17 05:29:20 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:20 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874a402e-3cfc-4b69-b492-3cca815357ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0916697-d92b-415e-b9c0-43eaaf7c9588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14" returned: 0 in 0.543s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Volume volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 (e6b01b87-cf2f-4874-8b5b-4c66a3f969f2): created successfully Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0916697-d92b-415e-b9c0-43eaaf7c9588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Flow 'volume_create_manager' (714e252a-736e-4084-a5d2-c6d37190dee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:20 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14 Jul 17 05:29:20 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-23cb30d1-41f4-4014-a5b0-18698bef651f tempest-VolumesTestJSON-2090208706 None] Created volume successfully. Jul 17 05:29:20 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9e588939-92d0-470a-8484-074cf44ac0e2" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "cinder-quobyte-9e588939-92d0-470a-8484-074cf44ac0e2" released by "delete_volume" :: held 0.845s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Created reservations ['2c57c156-8b6a-4699-8d47-09d72ac59d8b', '7a20db25-a10b-4b74-8d22-61f54df53a90', 'dacc9ba0-b5ba-4b39-8c6c-890caf018dd2', 'c6920583-ba92-478a-b414-0dd073c23fe2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:20 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411.e6f2c14a-b421-4d1e-962c-268f97745b14" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-e6f2c14a-b421-4d1e-962c-268f97745b14" released by "_delete_snapshot" :: held 1.939s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" released by "delete_snapshot" :: held 1.981s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:21 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:21 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Created reservations ['e8c8cada-1a77-4256-816e-8bf34082df86', '812bc304-0411-4785-b072-00d428a6aaf6', 'd8484627-cb67-4be4-ac95-3da40cf87031', '830c3b59-d12f-4318-87be-f0bc825693e8'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Delete snapshot completed successfully. Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-e6f2c14a-b421-4d1e-962c-268f97745b14-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Snapshots deleted, issuing volume delete {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8541f65-1cb6-4396-85ec-e229a49339be]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:21 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.346s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Deleted volume successfully. Jul 17 05:29:21 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 Jul 17 05:29:21 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-265e1220-b44b-43d8-9405-840349071a23 tempest-AttachVolumeShelveTestJSON-1100771202 None] Lock "cinder-9e588939-92d0-470a-8484-074cf44ac0e2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:21 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411" returned: 0 in 0.527s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:21 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411 Jul 17 05:29:21 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:22 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b41caf02-cc39-42a4-88a0-407998d47411" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-b41caf02-cc39-42a4-88a0-407998d47411" released by "delete_volume" :: held 0.979s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Created reservations ['33dd7efe-dcc2-4476-98f6-62416d34893d', '81dd66fe-b943-4d15-9789-8e4b222c7f98', 'a0de36d0-84ae-4690-8294-8f810ae8c1bb', 'a0a372de-d85b-4416-83a5-2a2d87e52c00'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Flow 'volume_create_manager' (4d8f8185-840d-44bb-bcd8-c65db7156c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b4ce8a-ff7a-4114-912f-ac06ebac96c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b4ce8a-ff7a-4114-912f-ac06ebac96c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1060527039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0bfbe86-2052-4911-beb7-08af5eb56908,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14877b34794349a6b980d9b3cca0506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:22Z,use_quota=True,user_id='0c5ce09929104b8f8fd30c15ea4d9376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58061c5-449b-4e93-8b0e-042a8ff053b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58061c5-449b-4e93-8b0e-042a8ff053b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b8a5d-6147-4b98-a7ff-4a4d5c271732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b8a5d-6147-4b98-a7ff-4a4d5c271732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0bfbe86-2052-4911-beb7-08af5eb56908', 'volume_name': 'volume-a0bfbe86-2052-4911-beb7-08af5eb56908', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0495845-6a29-4fe5-bae1-e4cd3a6f53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0495845-6a29-4fe5-bae1-e4cd3a6f53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b0ae86-ca8e-429b-a944-6c11fe20c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Volume a0bfbe86-2052-4911-beb7-08af5eb56908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0bfbe86-2052-4911-beb7-08af5eb56908', 'volume_size': 1} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1060527039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0bfbe86-2052-4911-beb7-08af5eb56908,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14877b34794349a6b980d9b3cca0506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:22Z,use_quota=True,user_id='0c5ce09929104b8f8fd30c15ea4d9376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Creating volume a0bfbe86-2052-4911-beb7-08af5eb56908 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:22 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:22 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 1073741824 Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:22 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:22 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:22 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:22 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Deleted volume successfully. Jul 17 05:29:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8da0be-83a2-4ae9-b413-7f4985dbd545 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-b41caf02-cc39-42a4-88a0-407998d47411-delete_volume" released by "delete_volume" :: held 6.495s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:23 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 1073741824" returned: 0 in 0.714s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:23 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 Jul 17 05:29:23 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:23 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b0ae86-ca8e-429b-a944-6c11fe20c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0bfbe86-2052-4911-beb7-08af5eb56908', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc2615-19f5-47d1-bc9a-9ccf94e2904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Volume volume-a0bfbe86-2052-4911-beb7-08af5eb56908 (a0bfbe86-2052-4911-beb7-08af5eb56908): created successfully Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc2615-19f5-47d1-bc9a-9ccf94e2904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Flow 'volume_create_manager' (4d8f8185-840d-44bb-bcd8-c65db7156c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c0b8256c-c3a1-4275-b6b6-8dadff1b5302 tempest-VolumesTestJSON-2090208706 None] Created volume successfully. Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=76,cinder:SELECT=79,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Flow 'volume_create_manager' (7b5cee5d-7b78-44ee-a53b-b99092e8f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fbfb86-6234-427b-b497-ba2dbbc3facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fbfb86-6234-427b-b497-ba2dbbc3facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-633513186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be609b4b-d6e2-4ba1-8aca-13f27f26b862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4308914668455295f80e07727e4dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:24Z,use_quota=True,user_id='bac93971a6fd46c9849ef6c0b110e1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720f869e-0e9c-4bc2-9d17-c76a63a870c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720f869e-0e9c-4bc2-9d17-c76a63a870c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41afd3b-c332-4fce-9e0f-57a513056e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41afd3b-c332-4fce-9e0f-57a513056e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be609b4b-d6e2-4ba1-8aca-13f27f26b862', 'volume_name': 'volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dab014-9467-40f5-8d8f-1c08afb358ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dab014-9467-40f5-8d8f-1c08afb358ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c485638d-e15f-4c66-af5a-28172c53c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Volume be609b4b-d6e2-4ba1-8aca-13f27f26b862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862', 'volume_size': 1} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-633513186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be609b4b-d6e2-4ba1-8aca-13f27f26b862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4308914668455295f80e07727e4dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:24Z,use_quota=True,user_id='bac93971a6fd46c9849ef6c0b110e1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Creating volume be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:24 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:24 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 1073741824 Jul 17 05:29:24 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:24 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 1073741824" returned: 0 in 0.636s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:25 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 Jul 17 05:29:25 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:25 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c485638d-e15f-4c66-af5a-28172c53c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5044dcbc-efb1-49e7-ab9e-16d52a160019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Volume volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 (be609b4b-d6e2-4ba1-8aca-13f27f26b862): created successfully Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5044dcbc-efb1-49e7-ab9e-16d52a160019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Flow 'volume_create_manager' (7b5cee5d-7b78-44ee-a53b-b99092e8f22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-841efb02-7ed8-4a9b-971e-6dd2658884ee tempest-VolumesDeleteCascade-894014668 None] Created volume successfully. Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Acquiring lock "cinder-a0bfbe86-2052-4911-beb7-08af5eb56908-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Lock "cinder-a0bfbe86-2052-4911-beb7-08af5eb56908-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Acquiring lock "cinder-quobyte-a0bfbe86-2052-4911-beb7-08af5eb56908" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Lock "cinder-quobyte-a0bfbe86-2052-4911-beb7-08af5eb56908" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7837eda-3ff6-4265-9184-d636d8d3721d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:26 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 Jul 17 05:29:26 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Creating offline snapshot 36633e9f-bb5e-4034-b9eb-164a78394897 of volume be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73549d-62c4-49ea-8f73-7a70829dfb5e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:26 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908" returned: 0 in 0.561s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:26 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908 Jul 17 05:29:26 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:26 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 Jul 17 05:29:26 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:26 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a0bfbe86-2052-4911-beb7-08af5eb56908" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Lock "cinder-quobyte-a0bfbe86-2052-4911-beb7-08af5eb56908" released by "delete_volume" :: held 1.018s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Created reservations ['7e96acd7-1522-47b4-9be0-b7c024c686f1', '55971805-4b52-4939-bd6a-53b6811b0028', 'd7d517bc-2285-48f0-980a-0355c151192d', '70814c9f-acd3-4b8b-aa8d-be06885d07a5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:26 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862" returned: 0 in 0.533s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:26 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 1G Jul 17 05:29:26 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:27 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:27 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:27 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Deleted volume successfully. Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebe9a3f8-0fcc-4f01-98c2-67770a70697c tempest-VolumesTestJSON-2090208706 None] Lock "cinder-a0bfbe86-2052-4911-beb7-08af5eb56908-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:27 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 1G" returned: 0 in 0.531s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:27 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 Jul 17 05:29:27 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:27 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897" returned: 0 in 0.365s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:27 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 is being set with open permissions: ugo+rw Jul 17 05:29:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:27 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 Jul 17 05:29:27 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Acquiring lock "cinder-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Lock "cinder-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:28 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Acquiring lock "cinder-quobyte-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:28 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.info Jul 17 05:29:28 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Lock "cinder-quobyte-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a7067c-f5cd-49fd-863b-415dd394dade]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:28 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 Jul 17 05:29:28 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:28 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.info" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.info is being set with open permissions: ugo+rw Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:28 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.info Jul 17 05:29:28 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:28 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2" returned: 0 in 0.466s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:28 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2 Jul 17 05:29:28 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:28 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.info" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-218260b7-2ee3-4c13-bb1b-abb1a5e8bfbd tempest-VolumesDeleteCascade-894014668 None] Create snapshot completed successfully Jul 17 05:29:29 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Lock "cinder-quobyte-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2" released by "delete_volume" :: held 0.871s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Created reservations ['7eb4e011-b3d6-4ea8-8dfe-31e8233df133', 'b2b7a209-5def-4a2e-8bf7-583a5b155ad0', '23283d66-be7b-49fb-99c5-2e5bbfd1c716', '54fc0768-9cd7-4057-b400-bec2c00153b9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:29 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:29 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Acquiring lock "cinder-3a58fa20-79a6-44df-9f6d-65c837bf3cee-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Lock "cinder-3a58fa20-79a6-44df-9f6d-65c837bf3cee-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Acquiring lock "cinder-quobyte-3a58fa20-79a6-44df-9f6d-65c837bf3cee" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Lock "cinder-quobyte-3a58fa20-79a6-44df-9f6d-65c837bf3cee" acquired by "delete_volume" :: waited 0.045s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:29 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[253dcff6-df20-4df0-b504-d00c5b99087e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Deleted volume successfully. Jul 17 05:29:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b0f7d63b-a1d9-4a2e-981d-00138f68c0ca tempest-VolumesTestJSON-2090208706 None] Lock "cinder-e6b01b87-cf2f-4874-8b5b-4c66a3f969f2-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:29 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee Jul 17 05:29:29 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:30 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee" returned: 0 in 0.731s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:30 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee Jul 17 05:29:30 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Flow 'volume_create_manager' (596d3c64-edb6-4cae-b35c-2f95616197a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83a1520-6d87-4d16-a363-dd6a8f9e26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83a1520-6d87-4d16-a363-dd6a8f9e26dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1221645326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179bc118-a602-4b67-b673-9ae8206ae92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4308914668455295f80e07727e4dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36633e9f-bb5e-4034-b9eb-164a78394897,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:30Z,use_quota=True,user_id='bac93971a6fd46c9849ef6c0b110e1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a3f99f-2c93-48c2-9bf0-2e9b2fba8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a3f99f-2c93-48c2-9bf0-2e9b2fba8304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17958a30-12e7-48ad-9f82-8b43faf03d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17958a30-12e7-48ad-9f82-8b43faf03d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '179bc118-a602-4b67-b673-9ae8206ae92f', 'volume_name': 'volume-179bc118-a602-4b67-b673-9ae8206ae92f', 'volume_size': 1, 'snapshot_id': '36633e9f-bb5e-4034-b9eb-164a78394897'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa15972-4cee-4a84-84f3-66453e36248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa15972-4cee-4a84-84f3-66453e36248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83d5d8a-d9fa-4afa-8d4b-651804d7c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Volume 179bc118-a602-4b67-b673-9ae8206ae92f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-179bc118-a602-4b67-b673-9ae8206ae92f', 'volume_size': 1, 'snapshot_id': '36633e9f-bb5e-4034-b9eb-164a78394897'} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-36633e9f-bb5e-4034-b9eb-164a78394897-179bc118-a602-4b67-b673-9ae8206ae92f" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-36633e9f-bb5e-4034-b9eb-164a78394897-179bc118-a602-4b67-b673-9ae8206ae92f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Creating volume 179bc118-a602-4b67-b673-9ae8206ae92f from snapshot 36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-179bc118-a602-4b67-b673-9ae8206ae92f" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-179bc118-a602-4b67-b673-9ae8206ae92f" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] snapshot: 36633e9f-bb5e-4034-b9eb-164a78394897, volume: 179bc118-a602-4b67-b673-9ae8206ae92f, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cacc9f3-e02b-40fd-bc4b-2216778cc84b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:30 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3a58fa20-79a6-44df-9f6d-65c837bf3cee" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Lock "cinder-quobyte-3a58fa20-79a6-44df-9f6d-65c837bf3cee" released by "delete_volume" :: held 1.143s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Created reservations ['f9578a9a-ee15-4b98-b606-05b168312b6f', '60e3de70-17c7-4013-aecf-3f160b728812', '8e3f0cc3-148b-4afe-86d1-debf26c6eed5', 'ee101044-dfc8-43a6-8fa3-a6b0df31913e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:30 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 Jul 17 05:29:30 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:30 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:30 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:31 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.312s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:31 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Deleted volume successfully. Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897" returned: 0 in 0.582s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6739d7-0384-4a82-9cca-317d98903154]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17a5a275-5afe-479a-b0fe-ec39d36a3db8 tempest-VolumesTestJSON-2090208706 None] Lock "cinder-3a58fa20-79a6-44df-9f6d-65c837bf3cee-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:31 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 Jul 17 05:29:31 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:31 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862" returned: 0 in 0.449s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:29:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:31 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f Jul 17 05:29:31 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f" returned: 0 in 6.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b52302-03ca-4bed-a386-70ddbebc4378]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:38 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 Jul 17 05:29:38 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:38 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862" returned: 0 in 0.746s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:38 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:29:38 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Converted 1024.00 MB image at 158.07 MB/s Jul 17 05:29:38 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f is being set with open permissions: ugo+rw Jul 17 05:29:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:39 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f Jul 17 05:29:39 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:39 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-179bc118-a602-4b67-b673-9ae8206ae92f" released by "_copy_volume_from_snapshot" :: held 8.757s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-36633e9f-bb5e-4034-b9eb-164a78394897-179bc118-a602-4b67-b673-9ae8206ae92f" released by "_create_volume_from_snapshot" :: held 8.814s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.838s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83d5d8a-d9fa-4afa-8d4b-651804d7c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179bc118-a602-4b67-b673-9ae8206ae92f', 'volume_size': 1, 'snapshot_id': '36633e9f-bb5e-4034-b9eb-164a78394897'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77813c68-f472-4931-985f-6d778a86a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Volume volume-179bc118-a602-4b67-b673-9ae8206ae92f (179bc118-a602-4b67-b673-9ae8206ae92f): created successfully Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77813c68-f472-4931-985f-6d778a86a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Flow 'volume_create_manager' (596d3c64-edb6-4cae-b35c-2f95616197a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9b345a3d-ea0e-43a0-b2a3-fd3c5d849318 tempest-VolumesDeleteCascade-894014668 None] Created volume successfully. Jul 17 05:29:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-be609b4b-d6e2-4ba1-8aca-13f27f26b862-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-be609b4b-d6e2-4ba1-8aca-13f27f26b862-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Performing cascade delete. {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 05:29:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-36633e9f-bb5e-4034-b9eb-164a78394897-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-36633e9f-bb5e-4034-b9eb-164a78394897-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-be609b4b-d6e2-4ba1-8aca-13f27f26b862" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-be609b4b-d6e2-4ba1-8aca-13f27f26b862" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-36633e9f-bb5e-4034-b9eb-164a78394897" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-36633e9f-bb5e-4034-b9eb-164a78394897" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Deleting offline snapshot 36633e9f-bb5e-4034-b9eb-164a78394897 of volume be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] snapshot_file for this snap is: volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c04eaa-d235-40f1-8f2f-5269c8e12071]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:41 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 Jul 17 05:29:41 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f7b7bd34-e112-4eb7-b66e-8e7566681506 tempest-GroupSnapshotsTest-1874375933 None] Group tempest-GroupSnapshotsTest-Group-258920235: creating Jul 17 05:29:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f7b7bd34-e112-4eb7-b66e-8e7566681506 tempest-GroupSnapshotsTest-1874375933 None] Group tempest-GroupSnapshotsTest-Group-258920235: created successfully Jul 17 05:29:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f7b7bd34-e112-4eb7-b66e-8e7566681506 tempest-GroupSnapshotsTest-1874375933 None] Create group completed successfully. Jul 17 05:29:41 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897" returned: 0 in 0.619s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d86bd-30c1-40e8-a96d-25079a43906b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:41 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 Jul 17 05:29:41 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:42 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862" returned: 0 in 0.722s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:42 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 Jul 17 05:29:42 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:43 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897" returned: 0 in 0.656s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:43 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897 Jul 17 05:29:43 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:43 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862.36633e9f-bb5e-4034-b9eb-164a78394897" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-36633e9f-bb5e-4034-b9eb-164a78394897" released by "_delete_snapshot" :: held 2.522s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-be609b4b-d6e2-4ba1-8aca-13f27f26b862" released by "delete_snapshot" :: held 2.588s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (49be7bdf-69fc-4228-9e13-c0bc181ed6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab581d71-e944-45b8-8f89-1a325fb268a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab581d71-e944-45b8-8f89-1a325fb268a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886660453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ede73216-4579-4998-a9b3-f9e3f1baa0a1,host='devstack@QuobyteHD#QuobyteHD',id=19ea0af2-14f2-4603-a713-f0fff74b7f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:44Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7d71251-3856-48d4-9abb-42692b34899b),volume_type_id=c7d71251-3856-48d4-9abb-42692b34899b)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e63dae-8111-4b99-b4ef-a884bdc25098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e63dae-8111-4b99-b4ef-a884bdc25098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aed26ad-cf07-41ad-ad3b-400d951bb30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aed26ad-cf07-41ad-ad3b-400d951bb30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ea0af2-14f2-4603-a713-f0fff74b7f85', 'volume_name': 'volume-19ea0af2-14f2-4603-a713-f0fff74b7f85', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992779d5-ee7e-4252-8133-f5fb5c4f4339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992779d5-ee7e-4252-8133-f5fb5c4f4339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b38d8-104b-4cd2-a9d7-da316b81d13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Volume 19ea0af2-14f2-4603-a713-f0fff74b7f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ea0af2-14f2-4603-a713-f0fff74b7f85', 'volume_size': 1} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ede73216-4579-4998-a9b3-f9e3f1baa0a1,created_at=2026-07-17T03:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886660453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ede73216-4579-4998-a9b3-f9e3f1baa0a1,host='devstack@QuobyteHD#QuobyteHD',id=19ea0af2-14f2-4603-a713-f0fff74b7f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:44Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7d71251-3856-48d4-9abb-42692b34899b),volume_type_id=c7d71251-3856-48d4-9abb-42692b34899b)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Creating volume 19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:43 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 1073741824 Jul 17 05:29:43 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Created reservations ['b7ab7232-3f00-4fcd-ba69-e3c4295acf0a', '19ff8f62-7fb8-4640-b3f9-bbc08a53b060', '3abcf8d6-d96b-4e99-bc87-dce92729bc98', '13ea7441-6e6e-419e-8539-df811a1549ae'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Delete snapshot completed successfully. Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-36633e9f-bb5e-4034-b9eb-164a78394897-delete_snapshot" released by "delete_snapshot" :: held 3.010s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Snapshots deleted, issuing volume delete {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 05:29:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-be609b4b-d6e2-4ba1-8aca-13f27f26b862" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-be609b4b-d6e2-4ba1-8aca-13f27f26b862" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fb1753-9758-4a0e-85ea-278b9050b7bc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:44 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 Jul 17 05:29:44 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:44 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 1073741824" returned: 0 in 0.806s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:44 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 Jul 17 05:29:44 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:44 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862" returned: 0 in 0.743s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:44 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862 Jul 17 05:29:44 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:45 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b38d8-104b-4cd2-a9d7-da316b81d13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ea0af2-14f2-4603-a713-f0fff74b7f85', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637269ea-a08b-412e-bfcc-33dba37c8f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Volume volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 (19ea0af2-14f2-4603-a713-f0fff74b7f85): created successfully Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637269ea-a08b-412e-bfcc-33dba37c8f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (49be7bdf-69fc-4228-9e13-c0bc181ed6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a4c829ba-d635-400e-9e4a-50f1e2bc5f9a tempest-GroupSnapshotsTest-1874375933 None] Created volume successfully. Jul 17 05:29:45 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-be609b4b-d6e2-4ba1-8aca-13f27f26b862" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-be609b4b-d6e2-4ba1-8aca-13f27f26b862" released by "delete_volume" :: held 1.246s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Created reservations ['90c67b00-1753-424f-9450-d74446ae6863', '2d4fe46d-7cca-4b5d-961c-3d64bdd94869', '1aaaa9bd-ac8c-4038-9210-2e73157b0e93', 'adb57718-4f01-449d-b6cf-81efa3bd1902'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:45 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:45 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:45 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Deleted volume successfully. Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-179bc118-a602-4b67-b673-9ae8206ae92f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-af714b30-6f36-4ebe-8646-3aeec71ae5f3 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-be609b4b-d6e2-4ba1-8aca-13f27f26b862-delete_volume" released by "delete_volume" :: held 4.988s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-179bc118-a602-4b67-b673-9ae8206ae92f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "cinder-quobyte-179bc118-a602-4b67-b673-9ae8206ae92f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-179bc118-a602-4b67-b673-9ae8206ae92f" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[78526aac-e86e-47d0-9c46-f292dc885d5f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:46 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f Jul 17 05:29:46 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:46 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f" returned: 0 in 0.705s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:46 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f Jul 17 05:29:46 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] GroupSnapshot 9fbe80c2-35de-41be-af5e-562ccc8c68e7: creating. Jul 17 05:29:47 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-179bc118-a602-4b67-b673-9ae8206ae92f" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Group snapshot 9fbe80c2-35de-41be-af5e-562ccc8c68e7: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-quobyte-179bc118-a602-4b67-b673-9ae8206ae92f" released by "delete_volume" :: held 1.174s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Creating offline snapshot 4d98df28-17fc-426b-92b5-d21d4484b313 of volume 19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5ab100-d2fa-467d-aa3e-50ea6402b632]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Created reservations ['77892774-a226-421e-ad4e-811b451a1754', 'fdad4257-13f1-4f17-acaf-442ad367e558', 'd971c6bd-4166-4b0b-8dab-81449b5046d1', 'b5a913dc-aca1-476a-ae81-24609ef92907'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:47 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:47 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:47 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 Jul 17 05:29:47 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:47 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.456s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Deleted volume successfully. Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bda1d6cc-364c-4dc9-8436-45b6e9fca389 tempest-VolumesDeleteCascade-894014668 None] Lock "cinder-179bc118-a602-4b67-b673-9ae8206ae92f-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:47 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85" returned: 0 in 0.726s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:47 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 1G Jul 17 05:29:47 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:48 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 1G" returned: 0 in 0.694s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:48 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 Jul 17 05:29:48 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:49 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:49 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:29:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:49 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 Jul 17 05:29:49 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:49 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:49 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.info Jul 17 05:29:49 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:49 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.info" returned: 0 in 0.449s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:49 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:29:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:49 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.info Jul 17 05:29:49 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:50 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.info" returned: 0 in 0.466s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.207s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d4bb76bd-a3b6-434e-8ea9-da57ede5ca69 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot 9fbe80c2-35de-41be-af5e-562ccc8c68e7: created successfully Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-4d98df28-17fc-426b-92b5-d21d4484b313-20dd4127-fb42-4f6b-844e-00cfe993c6fe" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-4d98df28-17fc-426b-92b5-d21d4484b313-20dd4127-fb42-4f6b-844e-00cfe993c6fe" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Creating volume 20dd4127-fb42-4f6b-844e-00cfe993c6fe from snapshot 4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-20dd4127-fb42-4f6b-844e-00cfe993c6fe" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-20dd4127-fb42-4f6b-844e-00cfe993c6fe" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] snapshot: 4d98df28-17fc-426b-92b5-d21d4484b313, volume: 20dd4127-fb42-4f6b-844e-00cfe993c6fe, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a382c-f1d4-46d1-8735-4469156f144a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:52 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 Jul 17 05:29:52 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=138,cinder:SELECT=102,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Flow 'volume_create_manager' (c25d2b82-4b56-4ab5-abac-aaa1dbf48482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbfe075-397c-46ce-bf4d-f9c2e036f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbfe075-397c-46ce-bf4d-f9c2e036f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1759904610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047ed555-8de4-484e-a93b-afde1c60383e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543f548e504b4e0fa8a5a74874156663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:53Z,use_quota=True,user_id='6b5e3a84fe444760b4d71b509b8bc043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb001a86-1882-4faf-b154-50d35de56ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb001a86-1882-4faf-b154-50d35de56ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ec159-71b2-43f8-b24b-9c55a43e9369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ec159-71b2-43f8-b24b-9c55a43e9369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047ed555-8de4-484e-a93b-afde1c60383e', 'volume_name': 'volume-047ed555-8de4-484e-a93b-afde1c60383e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5720655-2c59-4cfb-866a-b9519eac6c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5720655-2c59-4cfb-866a-b9519eac6c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34adfd2-377c-43b7-8398-1167de65a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:29:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Volume 047ed555-8de4-484e-a93b-afde1c60383e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047ed555-8de4-484e-a93b-afde1c60383e', 'volume_size': 1} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:53 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313" returned: 0 in 0.560s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ea0af2-14f2-4603-a713-f0fff74b7f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55599a3-8b3a-455c-a21e-0d92168c4199]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:53 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 Jul 17 05:29:53 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:53 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:29:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:53 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe Jul 17 05:29:53 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:56 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:29:56 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:56 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.517s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:29:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:29:59 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe" returned: 0 in 5.589s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c6de44-f22c-4362-b39b-698894f9f644]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:59 devstack sudo[91829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 Jul 17 05:29:59 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:59 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:29:59 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Converted 1024.00 MB image at 183.20 MB/s Jul 17 05:29:59 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:59 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe Jul 17 05:29:59 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:29:59 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-20dd4127-fb42-4f6b-844e-00cfe993c6fe" released by "_copy_volume_from_snapshot" :: held 7.491s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-4d98df28-17fc-426b-92b5-d21d4484b313-20dd4127-fb42-4f6b-844e-00cfe993c6fe" released by "_create_volume_from_snapshot" :: held 7.543s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.582s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.911s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1759904610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047ed555-8de4-484e-a93b-afde1c60383e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543f548e504b4e0fa8a5a74874156663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:29:53Z,use_quota=True,user_id='6b5e3a84fe444760b4d71b509b8bc043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Creating volume 047ed555-8de4-484e-a93b-afde1c60383e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:29:59 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:29:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:29:59 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e 1073741824 Jul 17 05:30:00 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e27d3449-abdb-401c-96f6-dbe3a25c6cdf tempest-GroupSnapshotsTest-1874375933 None] Create group from source-snapshot-9fbe80c2-35de-41be-af5e-562ccc8c68e7 completed successfully. Jul 17 05:30:00 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e 1073741824" returned: 0 in 0.500s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:00 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e Jul 17 05:30:00 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-20dd4127-fb42-4f6b-844e-00cfe993c6fe" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-20dd4127-fb42-4f6b-844e-00cfe993c6fe" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1376aa49-36d0-4904-a264-45ed6c73d007]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:00 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34adfd2-377c-43b7-8398-1167de65a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047ed555-8de4-484e-a93b-afde1c60383e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e61477d-4f25-4784-8008-8079df9b4019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Volume volume-047ed555-8de4-484e-a93b-afde1c60383e (047ed555-8de4-484e-a93b-afde1c60383e): created successfully Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e61477d-4f25-4784-8008-8079df9b4019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Flow 'volume_create_manager' (c25d2b82-4b56-4ab5-abac-aaa1dbf48482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d12a25a8-01db-4e55-bde9-4f4f97536143 tempest-VolumesMetadataTest-651927217 None] Created volume successfully. Jul 17 05:30:00 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe Jul 17 05:30:00 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:01 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:01 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe Jul 17 05:30:01 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:01 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-20dd4127-fb42-4f6b-844e-00cfe993c6fe" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-20dd4127-fb42-4f6b-844e-00cfe993c6fe" released by "delete_volume" :: held 0.716s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['5da4eae1-0e58-4f6a-b8d0-1a0da4f2637b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:01 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-601116133 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-601116133, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:01 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-601116133 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-601116133, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['a10ee01a-c7bf-4c94-b106-8db3b996c5a2', 'c0be69e4-57ef-4d4b-9776-c9a538a14a02', '0ecbe099-cb6a-4afa-b7bc-4a5d48d0b4fa', 'a03fa950-6bed-45ee-8547-7c966d600088'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:01 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:01 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:02 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] group_snapshot 9fbe80c2-35de-41be-af5e-562ccc8c68e7: deleting Jul 17 05:30:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b1ec7853-25da-4961-888f-118cefa9d5c8 tempest-GroupSnapshotsTest-1874375933 None] Delete group completed successfully. Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] group_snapshot 9fbe80c2-35de-41be-af5e-562ccc8c68e7: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-19ea0af2-14f2-4603-a713-f0fff74b7f85" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-19ea0af2-14f2-4603-a713-f0fff74b7f85" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-4d98df28-17fc-426b-92b5-d21d4484b313" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-4d98df28-17fc-426b-92b5-d21d4484b313" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Deleting offline snapshot 4d98df28-17fc-426b-92b5-d21d4484b313 of volume 19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] snapshot_file for this snap is: volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f4dec5-9994-45ac-896a-8896bbf1b73a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:02 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 Jul 17 05:30:02 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Acquiring lock "cinder-047ed555-8de4-484e-a93b-afde1c60383e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Lock "cinder-047ed555-8de4-484e-a93b-afde1c60383e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Acquiring lock "cinder-quobyte-047ed555-8de4-484e-a93b-afde1c60383e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Lock "cinder-quobyte-047ed555-8de4-484e-a93b-afde1c60383e" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3423cf94-364c-408b-bc8f-5179f4b6c008]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:03 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313" returned: 0 in 0.644s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ea0af2-14f2-4603-a713-f0fff74b7f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68a32a8-1a36-476e-a848-922f17acc793]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:03 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e Jul 17 05:30:03 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:03 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 Jul 17 05:30:03 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:03 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85" returned: 0 in 0.555s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:03 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e" returned: 0 in 0.680s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:03 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 Jul 17 05:30:03 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:03 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e Jul 17 05:30:03 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:04 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-047ed555-8de4-484e-a93b-afde1c60383e" returned: 0 in 0.472s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Lock "cinder-quobyte-047ed555-8de4-484e-a93b-afde1c60383e" released by "delete_volume" :: held 1.232s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:04 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313" returned: 0 in 0.674s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Created reservations ['90a56a78-7d36-486a-bb21-c2c3cf5fd0cd', '3ebb25de-b0c2-41d7-9bac-6703e856396b', '45155d96-1d27-499f-9433-749ea4eaf04c', '8cd1dfd3-7147-4e3d-a1b1-59b32bfff017'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:04 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313 Jul 17 05:30:04 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:04 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:04 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:04 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85.4d98df28-17fc-426b-92b5-d21d4484b313" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-4d98df28-17fc-426b-92b5-d21d4484b313" released by "_delete_snapshot" :: held 2.382s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-19ea0af2-14f2-4603-a713-f0fff74b7f85" released by "delete_snapshot" :: held 2.414s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:04 devstack cinder-volume[87750]: WARNING cinder.quota [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-601116133 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-601116133, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:04 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.309s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Deleted volume successfully. Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['087a2e74-0cf1-4e50-857c-430e8cb505d8', 'e35cf3dd-fe5b-4b01-84e2-9e33cadf3c0c', '8a24581d-c4c4-40c3-b60f-652f99af2601', '922d94c6-d630-4f9d-9017-b6a77a0f368b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-448979fd-eee8-48bf-9eaf-92fe7a69235f tempest-VolumesMetadataTest-651927217 None] Lock "cinder-047ed555-8de4-484e-a93b-afde1c60383e-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-617711cc-4afa-498c-9389-f2d22001791d tempest-GroupSnapshotsTest-1874375933 None] group_snapshot 9fbe80c2-35de-41be-af5e-562ccc8c68e7: deleted successfully Jul 17 05:30:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-19ea0af2-14f2-4603-a713-f0fff74b7f85" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-19ea0af2-14f2-4603-a713-f0fff74b7f85" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[51169af1-c305-413e-ad4e-e21aa2d2005d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:06 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 Jul 17 05:30:06 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:07 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85" returned: 0 in 0.824s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:07 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85 Jul 17 05:30:07 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19ea0af2-14f2-4603-a713-f0fff74b7f85" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:07 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-19ea0af2-14f2-4603-a713-f0fff74b7f85" released by "delete_volume" :: held 1.399s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['a5ed2080-e2c7-4080-8fcc-0c0a0f5e64f2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:07 devstack cinder-volume[87750]: WARNING cinder.db.api [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-601116133'] Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['5b8d42c5-8fbb-49a6-b11b-14b8b98497f9', '9028e29d-9d12-4128-b776-56d3617aed1c', '6e63deb2-3f44-4276-ac21-08fc3a03dce9', '197a24b9-2461-47b5-9314-09f0567ff4ce'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:08 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:08 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:08 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:08 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9f57064a-b80e-42e9-a074-ed0665f8e557 tempest-GroupSnapshotsTest-1874375933 None] Delete group completed successfully. Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Flow 'volume_create_manager' (f84c248f-af27-4bb8-9545-2d34c9031e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1cb5f1-6af4-4a01-bbb1-6e5075f7651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1cb5f1-6af4-4a01-bbb1-6e5075f7651b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1549524083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f76eb5e-65b9-427c-a0d3-98cfb66e0637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cafe807ca54d2ba8375c785ad967a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:09Z,use_quota=True,user_id='68aa3ce1db1c4f6ca018ceebbeda7b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb931c9e-d1f3-4a10-ad36-2e27df19a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb931c9e-d1f3-4a10-ad36-2e27df19a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963c4052-1ae8-44c1-ad9b-c80dc90d6412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963c4052-1ae8-44c1-ad9b-c80dc90d6412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f76eb5e-65b9-427c-a0d3-98cfb66e0637', 'volume_name': 'volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e727aa65-e146-4273-923c-ffc1581f1e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e727aa65-e146-4273-923c-ffc1581f1e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fe2c7d-b080-459e-af50-66ef56ded6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Volume 6f76eb5e-65b9-427c-a0d3-98cfb66e0637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637', 'volume_size': 1} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1549524083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f76eb5e-65b9-427c-a0d3-98cfb66e0637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cafe807ca54d2ba8375c785ad967a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:09Z,use_quota=True,user_id='68aa3ce1db1c4f6ca018ceebbeda7b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Creating volume 6f76eb5e-65b9-427c-a0d3-98cfb66e0637 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:09 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:09 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 1073741824 Jul 17 05:30:09 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5148fbcd-07f8-4da9-9f82-56d8659579ea tempest-GroupSnapshotsTest-1874375933 None] Group tempest-GroupSnapshotsTest-Group-532445479: creating Jul 17 05:30:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5148fbcd-07f8-4da9-9f82-56d8659579ea tempest-GroupSnapshotsTest-1874375933 None] Group tempest-GroupSnapshotsTest-Group-532445479: created successfully Jul 17 05:30:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5148fbcd-07f8-4da9-9f82-56d8659579ea tempest-GroupSnapshotsTest-1874375933 None] Create group completed successfully. Jul 17 05:30:10 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 1073741824" returned: 0 in 0.877s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:10 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 Jul 17 05:30:10 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:10 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fe2c7d-b080-459e-af50-66ef56ded6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3310ad-420d-4afa-8e39-b6a779793fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:10 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Volume volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 (6f76eb5e-65b9-427c-a0d3-98cfb66e0637): created successfully Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3310ad-420d-4afa-8e39-b6a779793fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Flow 'volume_create_manager' (f84c248f-af27-4bb8-9545-2d34c9031e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fa83e67d-1201-4424-85e7-476215349363 tempest-ServerActionsTestOtherA-595841764 None] Created volume successfully. Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (c721470d-7eb5-40b1-975a-4ea27f838abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbda18d5-8d4c-4b77-9f7f-789ba4465c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbda18d5-8d4c-4b77-9f7f-789ba4465c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-235969734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e545e8d4-3a7c-41ed-b42e-c0896c9ffd5e,host='devstack@QuobyteHD#QuobyteHD',id=db873449-96b2-4d7b-a677-e791719d9a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:12Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(714e58d4-ec90-43bc-91e2-5b5ebba39483),volume_type_id=714e58d4-ec90-43bc-91e2-5b5ebba39483)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546dad1d-7bc1-436b-b53b-8e14ee983b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546dad1d-7bc1-436b-b53b-8e14ee983b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e189795-861d-40b5-9fe5-722302a0382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e189795-861d-40b5-9fe5-722302a0382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db873449-96b2-4d7b-a677-e791719d9a03', 'volume_name': 'volume-db873449-96b2-4d7b-a677-e791719d9a03', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c961132-9216-4708-af86-c47fd72ba64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c961132-9216-4708-af86-c47fd72ba64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc39826e-d4b6-48ed-b707-6a78bcc69840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Volume db873449-96b2-4d7b-a677-e791719d9a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db873449-96b2-4d7b-a677-e791719d9a03', 'volume_size': 1} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e545e8d4-3a7c-41ed-b42e-c0896c9ffd5e,created_at=2026-07-17T03:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-235969734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e545e8d4-3a7c-41ed-b42e-c0896c9ffd5e,host='devstack@QuobyteHD#QuobyteHD',id=db873449-96b2-4d7b-a677-e791719d9a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:12Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(714e58d4-ec90-43bc-91e2-5b5ebba39483),volume_type_id=714e58d4-ec90-43bc-91e2-5b5ebba39483)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Creating volume db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:11 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 1073741824 Jul 17 05:30:11 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:12 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 1073741824" returned: 0 in 0.726s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:12 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 Jul 17 05:30:12 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:13 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc39826e-d4b6-48ed-b707-6a78bcc69840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db873449-96b2-4d7b-a677-e791719d9a03', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d51ecc9-fe75-417f-b09f-63a9b989075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Volume volume-db873449-96b2-4d7b-a677-e791719d9a03 (db873449-96b2-4d7b-a677-e791719d9a03): created successfully Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d51ecc9-fe75-417f-b09f-63a9b989075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (c721470d-7eb5-40b1-975a-4ea27f838abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5b7725c5-8d40-4f17-aa64-3aea65ee2f08 tempest-GroupSnapshotsTest-1874375933 None] Created volume successfully. Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Flow 'volume_create_manager' (22cb9c53-cccd-4b48-9338-5c34fa480bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f48dc8d-65dc-4f7b-a171-deb12c7bbfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f48dc8d-65dc-4f7b-a171-deb12c7bbfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-755070267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eafd8bb-d24e-4156-96bc-149d7add9a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b1cc24ec44a84bcc03bc7b1a823fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:14Z,use_quota=True,user_id='797edf656bd646d6a6c8c3eaa073ad4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326e2881-c713-421f-82c2-e563d0244a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326e2881-c713-421f-82c2-e563d0244a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6589a7-40d9-495d-b4fa-b2a9196d3dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6589a7-40d9-495d-b4fa-b2a9196d3dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eafd8bb-d24e-4156-96bc-149d7add9a42', 'volume_name': 'volume-3eafd8bb-d24e-4156-96bc-149d7add9a42', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0e3d5f-1fb8-4d2a-a5de-2c6aecba13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0e3d5f-1fb8-4d2a-a5de-2c6aecba13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aa5906-2ae0-4bd6-a871-725d43dd89d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Volume 3eafd8bb-d24e-4156-96bc-149d7add9a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eafd8bb-d24e-4156-96bc-149d7add9a42', 'volume_size': 1} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-755070267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eafd8bb-d24e-4156-96bc-149d7add9a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b1cc24ec44a84bcc03bc7b1a823fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:14Z,use_quota=True,user_id='797edf656bd646d6a6c8c3eaa073ad4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Creating volume 3eafd8bb-d24e-4156-96bc-149d7add9a42 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:14 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 1073741824 Jul 17 05:30:14 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:15 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 1073741824" returned: 0 in 1.015s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (b44594a2-0df1-42d8-82ef-732f612f2547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb4aa97-41bb-4647-a289-2f3f9a660f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb4aa97-41bb-4647-a289-2f3f9a660f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1179121274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e545e8d4-3a7c-41ed-b42e-c0896c9ffd5e,host='devstack@QuobyteHD#QuobyteHD',id=908be2e4-3650-44c6-9495-52aaef4ce51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:15Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(714e58d4-ec90-43bc-91e2-5b5ebba39483),volume_type_id=714e58d4-ec90-43bc-91e2-5b5ebba39483)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:15 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 Jul 17 05:30:15 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dfac12-3ee0-4e8e-b4fe-c52f70f905b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dfac12-3ee0-4e8e-b4fe-c52f70f905b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4eb01ad-60d6-450e-92c7-eaae35522e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4eb01ad-60d6-450e-92c7-eaae35522e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908be2e4-3650-44c6-9495-52aaef4ce51a', 'volume_name': 'volume-908be2e4-3650-44c6-9495-52aaef4ce51a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17757e92-c9e1-48bf-b264-480bf82a93d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17757e92-c9e1-48bf-b264-480bf82a93d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dd1b95-d51a-461b-987b-6e5deb4aff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Volume 908be2e4-3650-44c6-9495-52aaef4ce51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908be2e4-3650-44c6-9495-52aaef4ce51a', 'volume_size': 1} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:15 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42" returned: 0 in 0.380s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.233s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e545e8d4-3a7c-41ed-b42e-c0896c9ffd5e,created_at=2026-07-17T03:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1179121274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e545e8d4-3a7c-41ed-b42e-c0896c9ffd5e,host='devstack@QuobyteHD#QuobyteHD',id=908be2e4-3650-44c6-9495-52aaef4ce51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:15Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(714e58d4-ec90-43bc-91e2-5b5ebba39483),volume_type_id=714e58d4-ec90-43bc-91e2-5b5ebba39483)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Creating volume 908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:15 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aa5906-2ae0-4bd6-a871-725d43dd89d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eafd8bb-d24e-4156-96bc-149d7add9a42', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:15 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a 1073741824 Jul 17 05:30:15 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff19be5-36c3-4be4-9516-5cd23c937dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Volume volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 (3eafd8bb-d24e-4156-96bc-149d7add9a42): created successfully Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff19be5-36c3-4be4-9516-5cd23c937dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Flow 'volume_create_manager' (22cb9c53-cccd-4b48-9338-5c34fa480bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d0b7df1d-8d78-4862-9cca-ce3a014909ce tempest-VolumesTransfersV357Test-1664888294 None] Created volume successfully. Jul 17 05:30:16 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a 1073741824" returned: 0 in 0.706s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:16 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a Jul 17 05:30:16 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:17 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a" returned: 0 in 0.616s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dd1b95-d51a-461b-987b-6e5deb4aff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908be2e4-3650-44c6-9495-52aaef4ce51a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5da887f-70bf-4bad-b962-abd53eadb521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Volume volume-908be2e4-3650-44c6-9495-52aaef4ce51a (908be2e4-3650-44c6-9495-52aaef4ce51a): created successfully Jul 17 05:30:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5da887f-70bf-4bad-b962-abd53eadb521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (b44594a2-0df1-42d8-82ef-732f612f2547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0041c9d0-72c6-43c3-8c9e-2a4b62a1db49 tempest-GroupSnapshotsTest-1874375933 None] Created volume successfully. Jul 17 05:30:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-92ddae9f-4bee-4a07-a8b8-bcea6c5dd7fb tempest-VolumesTransfersV357Test-1517307275 None] Transfer volume completed successfully. Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Acquiring lock "cinder-3eafd8bb-d24e-4156-96bc-149d7add9a42-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-3eafd8bb-d24e-4156-96bc-149d7add9a42-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Acquiring lock "cinder-quobyte-3eafd8bb-d24e-4156-96bc-149d7add9a42" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-quobyte-3eafd8bb-d24e-4156-96bc-149d7add9a42" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ad9d70-9503-4a2b-b83f-7282262a6966]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e6ccad8c-9f75-495a-a79f-74354c4b2f2f tempest-GroupSnapshotsTest-1874375933 None] Update group completed successfully. Jul 17 05:30:18 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 Jul 17 05:30:18 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:18 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42" returned: 0 in 0.556s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:18 devstack sudo[92080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42 Jul 17 05:30:18 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:18 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3eafd8bb-d24e-4156-96bc-149d7add9a42" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-quobyte-3eafd8bb-d24e-4156-96bc-149d7add9a42" released by "delete_volume" :: held 0.872s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Created reservations ['59070ce5-4125-4b87-bc1c-7ff87ea44b7e', 'f61224b5-08eb-46da-b43f-2302222ce5ef', '6e14d8e4-5c33-4ad2-a063-975a8d1535a6', '4c46c959-250c-4990-99d9-b07e211c1e9e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:19 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:19 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:19 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.562s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-23cd4da5-b984-4313-bc83-1d38e35b7b2a tempest-GroupSnapshotsTest-1874375933 None] Update group completed successfully. Jul 17 05:30:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Deleted volume successfully. Jul 17 05:30:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-58c0af86-b10f-48b2-b4dc-60c911c51098 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-3eafd8bb-d24e-4156-96bc-149d7add9a42-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Flow 'volume_create_manager' (494ff6bf-cca5-43fc-b8ea-bef6e5e95548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26575ce9-1e70-4a27-be76-b16b8715f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26575ce9-1e70-4a27-be76-b16b8715f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1892631408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a820067-e39e-4415-a8f3-6ff2e60d5591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b1cc24ec44a84bcc03bc7b1a823fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:20Z,use_quota=True,user_id='797edf656bd646d6a6c8c3eaa073ad4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802ee710-eca2-4770-8165-cfbdce1d2ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802ee710-eca2-4770-8165-cfbdce1d2ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69d69fe-73aa-4719-9632-cf3d6d3a1ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69d69fe-73aa-4719-9632-cf3d6d3a1ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a820067-e39e-4415-a8f3-6ff2e60d5591', 'volume_name': 'volume-6a820067-e39e-4415-a8f3-6ff2e60d5591', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5110233-2f42-4123-9a3c-6a9399288c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5110233-2f42-4123-9a3c-6a9399288c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0b98b0-5b63-48fc-9442-306651613787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Volume 6a820067-e39e-4415-a8f3-6ff2e60d5591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a820067-e39e-4415-a8f3-6ff2e60d5591', 'volume_size': 1} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1892631408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a820067-e39e-4415-a8f3-6ff2e60d5591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9b1cc24ec44a84bcc03bc7b1a823fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:20Z,use_quota=True,user_id='797edf656bd646d6a6c8c3eaa073ad4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Creating volume 6a820067-e39e-4415-a8f3-6ff2e60d5591 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:20 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 1073741824 Jul 17 05:30:20 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6b83b0b5-e4b0-4426-9a13-8cf5950a3e2e tempest-GroupSnapshotsTest-1874375933 None] Update group completed successfully. Jul 17 05:30:21 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 1073741824" returned: 0 in 1.126s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:21 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 Jul 17 05:30:21 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:21 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0b98b0-5b63-48fc-9442-306651613787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a820067-e39e-4415-a8f3-6ff2e60d5591', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67f8bd9-4c24-4b94-bf12-7ae9d0499941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Volume volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 (6a820067-e39e-4415-a8f3-6ff2e60d5591): created successfully Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67f8bd9-4c24-4b94-bf12-7ae9d0499941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Flow 'volume_create_manager' (494ff6bf-cca5-43fc-b8ea-bef6e5e95548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a28f654a-7860-4ad6-bd8d-7b04ec6a4aed tempest-VolumesTransfersV357Test-1664888294 None] Created volume successfully. Jul 17 05:30:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-03fe44cd-4824-4bf1-872f-4a67414a3f0a tempest-GroupSnapshotsTest-1874375933 None] Update group completed successfully. Jul 17 05:30:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Acquiring lock "cinder-6a820067-e39e-4415-a8f3-6ff2e60d5591-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-6a820067-e39e-4415-a8f3-6ff2e60d5591-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Acquiring lock "cinder-quobyte-6a820067-e39e-4415-a8f3-6ff2e60d5591" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-quobyte-6a820067-e39e-4415-a8f3-6ff2e60d5591" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b713452-c946-4b81-9a78-4b52a59b3ae4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:22 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 Jul 17 05:30:22 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:23 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:23 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591 Jul 17 05:30:23 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:23 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6a820067-e39e-4415-a8f3-6ff2e60d5591" returned: 0 in 0.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-quobyte-6a820067-e39e-4415-a8f3-6ff2e60d5591" released by "delete_volume" :: held 0.750s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Created reservations ['6229c9c4-782d-469e-9549-bc0536b9fd3c', 'b0ae4275-8e4c-4d1d-9eea-9230f5db6137', '20a538f2-4458-4711-a5d4-4bd9157370ca', '3760ac39-544d-48b7-91a1-e46596782514'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:23 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:23 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:23 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:23 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Deleted volume successfully. Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d32bbff-4eaf-4df6-9b26-3e556b6c8810 tempest-VolumesTransfersV357Test-106599670 None] Lock "cinder-6a820067-e39e-4415-a8f3-6ff2e60d5591-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] GroupSnapshot dba1b5ae-e1ec-4381-8fcd-0f74499baf13: creating. Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=110,cinder:UPDATE=142,cinder:DELETE=7,cinder:INSERT=25 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Group snapshot dba1b5ae-e1ec-4381-8fcd-0f74499baf13: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Creating offline snapshot 37948d8f-e642-4501-b141-ec77b0ea55af of volume db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[999f3c7d-ebf8-4426-80d8-1b9e3e06cebc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:24 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 Jul 17 05:30:24 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:24 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03" returned: 0 in 0.499s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:24 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af 1G Jul 17 05:30:24 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:25 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af 1G" returned: 0 in 0.582s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db873449-96b2-4d7b-a677-e791719d9a03 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:25 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db873449-96b2-4d7b-a677-e791719d9a03 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af Jul 17 05:30:25 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:25 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db873449-96b2-4d7b-a677-e791719d9a03 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af" returned: 0 in 0.338s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:25 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:30:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:25 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af Jul 17 05:30:25 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:26 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:26 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.info Jul 17 05:30:26 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:26 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.info" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:26 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:26 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.info Jul 17 05:30:26 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:26 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.info" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Creating offline snapshot 3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 of volume 908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398c785-7920-494e-a8a1-fb3500c62910]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:26 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a Jul 17 05:30:26 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:27 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:27 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 1G Jul 17 05:30:27 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:27 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 1G" returned: 0 in 0.427s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908be2e4-3650-44c6-9495-52aaef4ce51a -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:27 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908be2e4-3650-44c6-9495-52aaef4ce51a -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 Jul 17 05:30:27 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:27 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908be2e4-3650-44c6-9495-52aaef4ce51a -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:27 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:30:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:27 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 Jul 17 05:30:27 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:28 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:28 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.info Jul 17 05:30:28 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:28 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.info" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:30:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:28 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.info Jul 17 05:30:28 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:28 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.info" returned: 0 in 0.375s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f184c95a-7831-47d5-89b5-071287bb8de5 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dba1b5ae-e1ec-4381-8fcd-0f74499baf13: created successfully Jul 17 05:30:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dba1b5ae-e1ec-4381-8fcd-0f74499baf13: deleting Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dba1b5ae-e1ec-4381-8fcd-0f74499baf13: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-db873449-96b2-4d7b-a677-e791719d9a03" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-db873449-96b2-4d7b-a677-e791719d9a03" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-37948d8f-e642-4501-b141-ec77b0ea55af" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-37948d8f-e642-4501-b141-ec77b0ea55af" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Deleting offline snapshot 37948d8f-e642-4501-b141-ec77b0ea55af of volume db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] snapshot_file for this snap is: volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5599f4-d2d5-42eb-9443-af477dffbf78]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:30 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af Jul 17 05:30:30 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:30 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af" returned: 0 in 0.740s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db873449-96b2-4d7b-a677-e791719d9a03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ee53bf-1423-42d2-98b2-9a39159fca96]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Flow 'volume_create_manager' (ca2d6e6c-b0e9-4347-8032-913d9412a46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5176ff61-9108-40f9-a98f-9493a5a3b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:30 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 Jul 17 05:30:30 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5176ff61-9108-40f9-a98f-9493a5a3b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-82376497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4696766-4071-4ab2-915c-11c2c64c98c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c90f7a9f4a7fa5e3912bf07f00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:31Z,use_quota=True,user_id='12472cd3391345ea9d9181aad73c2d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8334b7-d8c8-4560-8660-3a7b1ee64715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8334b7-d8c8-4560-8660-3a7b1ee64715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1eae20-e27c-4297-88ae-8bea3a87fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1eae20-e27c-4297-88ae-8bea3a87fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4696766-4071-4ab2-915c-11c2c64c98c8', 'volume_name': 'volume-c4696766-4071-4ab2-915c-11c2c64c98c8', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08b42fe-960e-4afa-81f7-dde731b46fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08b42fe-960e-4afa-81f7-dde731b46fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2454efbd-0f93-4a4e-b6b7-5141e11dcd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Volume c4696766-4071-4ab2-915c-11c2c64c98c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4696766-4071-4ab2-915c-11c2c64c98c8', 'volume_size': 2} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-82376497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4696766-4071-4ab2-915c-11c2c64c98c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c90f7a9f4a7fa5e3912bf07f00c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:31Z,use_quota=True,user_id='12472cd3391345ea9d9181aad73c2d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Creating volume c4696766-4071-4ab2-915c-11c2c64c98c8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:30 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 2147483648 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:31 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 2147483648 Jul 17 05:30:31 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:31 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03" returned: 0 in 0.395s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:31 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af Jul 17 05:30:31 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:31 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 2147483648" returned: 0 in 0.525s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:31 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:31 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 Jul 17 05:30:31 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:31 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af Jul 17 05:30:31 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:31 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2454efbd-0f93-4a4e-b6b7-5141e11dcd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4696766-4071-4ab2-915c-11c2c64c98c8', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68df679b-041f-4573-abcf-5bff722b57ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:31 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Volume volume-c4696766-4071-4ab2-915c-11c2c64c98c8 (c4696766-4071-4ab2-915c-11c2c64c98c8): created successfully Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68df679b-041f-4573-abcf-5bff722b57ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Flow 'volume_create_manager' (ca2d6e6c-b0e9-4347-8032-913d9412a46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03.37948d8f-e642-4501-b141-ec77b0ea55af" returned: 0 in 0.315s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-37948d8f-e642-4501-b141-ec77b0ea55af" released by "_delete_snapshot" :: held 1.962s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-997b6a6b-dbcb-4e0b-9e6e-e3c45b1598b1 tempest-VolumesCloneNegativeTest-2003633631 None] Created volume successfully. Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-db873449-96b2-4d7b-a677-e791719d9a03" released by "delete_snapshot" :: held 1.998s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-908be2e4-3650-44c6-9495-52aaef4ce51a" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-908be2e4-3650-44c6-9495-52aaef4ce51a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Deleting offline snapshot 3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 of volume 908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] snapshot_file for this snap is: volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb188b-1697-4061-89e0-917e00fb6ef2]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:32 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 Jul 17 05:30:32 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:32 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-908be2e4-3650-44c6-9495-52aaef4ce51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5254722d-5497-4b6b-be3a-ddf892985cc0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:32 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a Jul 17 05:30:32 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:32 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:32 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 Jul 17 05:30:32 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Acquiring lock "cinder-c4696766-4071-4ab2-915c-11c2c64c98c8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Lock "cinder-c4696766-4071-4ab2-915c-11c2c64c98c8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Flow 'volume_create_manager' (16b4c44a-5da0-47a9-af71-c83f52e9d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22411367-3633-44c9-a05b-b2109202c0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22411367-3633-44c9-a05b-b2109202c0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1434882540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2144338e-c43f-46f0-ad2f-5056d91a2520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36d9a396a58460abb341d0f1cf76292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:33Z,use_quota=True,user_id='8abf05d1187c4cd7b81a3be5b9aeeea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2ef7ca-51f7-43b2-ab1f-66b703158fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2ef7ca-51f7-43b2-ab1f-66b703158fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb87f559-e8b9-49d1-8f13-6cc5bfdf4bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb87f559-e8b9-49d1-8f13-6cc5bfdf4bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2144338e-c43f-46f0-ad2f-5056d91a2520', 'volume_name': 'volume-2144338e-c43f-46f0-ad2f-5056d91a2520', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b855b3-946a-4967-8995-4b381aa05d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:33 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b855b3-946a-4967-8995-4b381aa05d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e65e1e2-3edc-4c4e-a814-324e58ef47b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Volume 2144338e-c43f-46f0-ad2f-5056d91a2520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2144338e-c43f-46f0-ad2f-5056d91a2520', 'volume_size': 1} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1434882540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2144338e-c43f-46f0-ad2f-5056d91a2520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36d9a396a58460abb341d0f1cf76292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:33Z,use_quota=True,user_id='8abf05d1187c4cd7b81a3be5b9aeeea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Creating volume 2144338e-c43f-46f0-ad2f-5056d91a2520 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:33 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:33 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 1073741824 Jul 17 05:30:33 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Acquiring lock "cinder-quobyte-c4696766-4071-4ab2-915c-11c2c64c98c8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Lock "cinder-quobyte-c4696766-4071-4ab2-915c-11c2c64c98c8" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:33 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6 Jul 17 05:30:33 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9182b391-93ed-4a2d-8dce-c07f6b3c819a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:33 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 Jul 17 05:30:33 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:33 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a.3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" returned: 0 in 0.320s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-3c3f79d2-4c0d-4f00-97e6-cd5b409844c6" released by "_delete_snapshot" :: held 1.820s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-908be2e4-3650-44c6-9495-52aaef4ce51a" released by "delete_snapshot" :: held 1.845s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:33 devstack cinder-volume[87750]: WARNING cinder.quota [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-470058549 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-470058549, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:33 devstack cinder-volume[87750]: WARNING cinder.quota [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-470058549 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-470058549, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['ece84b24-1efd-4662-81cb-978ed0ba2d0d', '8dc29780-d1cc-486e-9d79-b80acafdab45', '168d9bce-2326-461f-acb6-3474036d69a0', '78b991ee-a493-4672-8d5c-752b83f6d1a9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:33 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 1073741824" returned: 0 in 0.510s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:33 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8" returned: 0 in 0.484s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:33 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 Jul 17 05:30:33 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:34 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8 Jul 17 05:30:34 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['6193e6ef-5f8c-4f56-903d-cf390f012d49', '35dceaa5-1ad1-4e8b-a0b7-6b82d531f0f3', 'c8a2f0b5-151c-4963-9f94-7232f4d9f9a0', '888f99fa-18b3-4ee1-9908-2a77c8f64a8f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-74629f6d-40f2-4423-a6be-0f28ee12eeb9 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dba1b5ae-e1ec-4381-8fcd-0f74499baf13: deleted successfully Jul 17 05:30:34 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e65e1e2-3edc-4c4e-a814-324e58ef47b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2144338e-c43f-46f0-ad2f-5056d91a2520', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d62bc77-1b92-44c9-bb48-79ea550bb541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Volume volume-2144338e-c43f-46f0-ad2f-5056d91a2520 (2144338e-c43f-46f0-ad2f-5056d91a2520): created successfully Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d62bc77-1b92-44c9-bb48-79ea550bb541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Flow 'volume_create_manager' (16b4c44a-5da0-47a9-af71-c83f52e9d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-17d34390-8864-4cdb-8fd1-92f3ce0e7c22 tempest-AttachVolumeTestJSON-412024937 None] Created volume successfully. Jul 17 05:30:34 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c4696766-4071-4ab2-915c-11c2c64c98c8" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Lock "cinder-quobyte-c4696766-4071-4ab2-915c-11c2c64c98c8" released by "delete_volume" :: held 0.915s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Created reservations ['ac910f0e-d725-4a87-9cd7-8076db0829f5', 'b7b47400-248f-439b-81f4-6c1a38933038', '34681ccf-7a46-48ba-9179-abd9b6d14780', '2e46bd2f-e382-48e2-9881-37963043f283'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:34 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:34 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:34 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Deleted volume successfully. Jul 17 05:30:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e80c4908-f327-4c68-80e8-abff58b5410e tempest-VolumesCloneNegativeTest-2003633631 None] Lock "cinder-c4696766-4071-4ab2-915c-11c2c64c98c8-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-908be2e4-3650-44c6-9495-52aaef4ce51a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-908be2e4-3650-44c6-9495-52aaef4ce51a" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2fd6f-ea1e-4097-a060-01a75f28c643]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:35 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a Jul 17 05:30:35 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:35 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a" returned: 0 in 0.399s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:35 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a Jul 17 05:30:35 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:35 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-908be2e4-3650-44c6-9495-52aaef4ce51a" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-908be2e4-3650-44c6-9495-52aaef4ce51a" released by "delete_volume" :: held 0.801s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-db873449-96b2-4d7b-a677-e791719d9a03" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-db873449-96b2-4d7b-a677-e791719d9a03" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[548d4188-c8a4-4c33-9308-503af449ceab]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:36 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 Jul 17 05:30:36 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3696d0f4-c558-4afc-b36e-07a91487e683 req-f81a5a75-1b2f-4a9d-bcbc-5179d1a6a424 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3696d0f4-c558-4afc-b36e-07a91487e683 req-f81a5a75-1b2f-4a9d-bcbc-5179d1a6a424 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3696d0f4-c558-4afc-b36e-07a91487e683 req-f81a5a75-1b2f-4a9d-bcbc-5179d1a6a424 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3696d0f4-c558-4afc-b36e-07a91487e683 req-f81a5a75-1b2f-4a9d-bcbc-5179d1a6a424 tempest-AttachVolumeTestJSON-412024937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-2144338e-c43f-46f0-ad2f-5056d91a2520', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdb88ad5-babe-4892-bab6-20268b210a76', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:30:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3696d0f4-c558-4afc-b36e-07a91487e683 req-f81a5a75-1b2f-4a9d-bcbc-5179d1a6a424 tempest-AttachVolumeTestJSON-412024937 None] attachment_update completed successfully. Jul 17 05:30:36 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03" returned: 0 in 0.451s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:36 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03 Jul 17 05:30:36 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:36 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-db873449-96b2-4d7b-a677-e791719d9a03" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-db873449-96b2-4d7b-a677-e791719d9a03" released by "delete_volume" :: held 0.827s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['d1ed1a8b-dacb-44fd-aeff-4fce5abaab52'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:36 devstack cinder-volume[87750]: WARNING cinder.quota [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-470058549 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-470058549, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['b65d7b53-4294-4c99-a42e-9b8693c68a08', '9e39f520-4394-418d-bb01-715b59d62188', '3a438334-ff66-494a-b244-b7960e536d3a', 'acf53558-0fb1-42ad-bcd0-db3edcd4cbe5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['798bbf60-2d44-4588-a1a6-d6b646fa0c6e', '52b11697-1883-41db-a713-4a8b4f830c92', 'cd76a6aa-fc5c-4b0a-a78c-df691c1f2bb6', 'cb1d8610-0691-4289-86a8-9619c981f97c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:37 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:37 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:37 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:37 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a2c03b19-7eb2-4181-b872-94a3b051cef4 tempest-GroupSnapshotsTest-1874375933 None] Delete group completed successfully. Jul 17 05:30:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-32b24467-fd49-4f0b-9d87-4e715c615280 tempest-GroupSnapshotsTest-1874375933 None] Group tempest-GroupSnapshotsTest-Group-757755272: creating Jul 17 05:30:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-32b24467-fd49-4f0b-9d87-4e715c615280 tempest-GroupSnapshotsTest-1874375933 None] Group tempest-GroupSnapshotsTest-Group-757755272: created successfully Jul 17 05:30:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-32b24467-fd49-4f0b-9d87-4e715c615280 tempest-GroupSnapshotsTest-1874375933 None] Create group completed successfully. Jul 17 05:30:38 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Flow 'volume_create_manager' (bafd0fde-7bbe-4e23-9325-c465660d02a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7381fd1f-689b-48a6-989c-1f8ea6d82e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7381fd1f-689b-48a6-989c-1f8ea6d82e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-561773280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84fb882-633d-4dba-a8cb-b7e59f8f9709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199a5875e7f04de28d66c95994b8c5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:39Z,use_quota=True,user_id='b26f17e1bbf043c29b732e129dbea3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9503ab3-0697-4059-a769-2b1dfde3b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9503ab3-0697-4059-a769-2b1dfde3b454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907801fa-b456-44c5-9ae1-62415a293051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907801fa-b456-44c5-9ae1-62415a293051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84fb882-633d-4dba-a8cb-b7e59f8f9709', 'volume_name': 'volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6143b05c-b348-47ab-a54c-07ddafe0a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6143b05c-b348-47ab-a54c-07ddafe0a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5285cc51-60f7-49b5-811f-85f33980ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Volume e84fb882-633d-4dba-a8cb-b7e59f8f9709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709', 'volume_size': 1} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-561773280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84fb882-633d-4dba-a8cb-b7e59f8f9709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199a5875e7f04de28d66c95994b8c5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:39Z,use_quota=True,user_id='b26f17e1bbf043c29b732e129dbea3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Creating volume e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:39 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 1073741824 Jul 17 05:30:39 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (edb8f183-8fd0-42e3-92c9-de7b0adfcfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9548e73b-ca38-4297-bea7-e6f9255a4e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9548e73b-ca38-4297-bea7-e6f9255a4e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803701534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e530938d-8006-41c3-a760-8ef2d9f3a1a1,host='devstack@QuobyteHD#QuobyteHD',id=7fd01e8e-6e86-4db5-aff6-197e452d47e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:39Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c22d9485-3956-4f9a-afc1-d03da0585088),volume_type_id=c22d9485-3956-4f9a-afc1-d03da0585088)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a12cc09-74bb-44f8-a1bb-12f05753235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a12cc09-74bb-44f8-a1bb-12f05753235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2acef99-35ee-4067-9126-cd630a537cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2acef99-35ee-4067-9126-cd630a537cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd01e8e-6e86-4db5-aff6-197e452d47e5', 'volume_name': 'volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a6a675-80eb-43b0-963b-fd1afb6cf8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a6a675-80eb-43b0-963b-fd1afb6cf8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd053ed8-2bc4-4ca4-a5b1-e480fdf90c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Volume 7fd01e8e-6e86-4db5-aff6-197e452d47e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5', 'volume_size': 1} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 1073741824" returned: 0 in 0.521s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:39 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 Jul 17 05:30:39 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:39 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e530938d-8006-41c3-a760-8ef2d9f3a1a1,created_at=2026-07-17T03:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803701534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e530938d-8006-41c3-a760-8ef2d9f3a1a1,host='devstack@QuobyteHD#QuobyteHD',id=7fd01e8e-6e86-4db5-aff6-197e452d47e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac9671c75442af8f99d0c48fc2ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:30:39Z,use_quota=True,user_id='b643f5e2f2514add8e217b6168cfb9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c22d9485-3956-4f9a-afc1-d03da0585088),volume_type_id=c22d9485-3956-4f9a-afc1-d03da0585088)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Creating volume 7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:30:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5285cc51-60f7-49b5-811f-85f33980ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a34f8a-e50b-4789-a639-49102edfae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:39 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 1073741824 Jul 17 05:30:39 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Volume volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 (e84fb882-633d-4dba-a8cb-b7e59f8f9709): created successfully Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a34f8a-e50b-4789-a639-49102edfae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Flow 'volume_create_manager' (bafd0fde-7bbe-4e23-9325-c465660d02a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-284f6b0c-cffc-405a-bc35-5c5c530e778a tempest-VolumesSnapshotListTestJSON-1892255116 None] Created volume successfully. Jul 17 05:30:40 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 1073741824" returned: 0 in 0.487s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:40 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 Jul 17 05:30:40 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:40 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd053ed8-2bc4-4ca4-a5b1-e480fdf90c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2ae7e3-6791-4b30-af0a-a5b56edd6981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:30:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Volume volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 (7fd01e8e-6e86-4db5-aff6-197e452d47e5): created successfully Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2ae7e3-6791-4b30-af0a-a5b56edd6981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:30:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Flow 'volume_create_manager' (edb8f183-8fd0-42e3-92c9-de7b0adfcfba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:30:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-95e9962c-bb06-4e1f-9974-57312064d553 tempest-GroupSnapshotsTest-1874375933 None] Created volume successfully. Jul 17 05:30:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Creating offline snapshot d2315d3a-fe23-4da4-94f4-16b7475fef24 of volume e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:30:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12ecd90-8d49-49bb-9695-ef5394ef1ede]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:41 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 Jul 17 05:30:41 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:42 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709" returned: 0 in 0.554s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:42 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 1G Jul 17 05:30:42 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] GroupSnapshot dc078e17-e099-4eeb-9835-1b96199d832f: creating. Jul 17 05:30:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Group snapshot dc078e17-e099-4eeb-9835-1b96199d832f: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 05:30:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:42 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 1G" returned: 0 in 0.754s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:42 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 Jul 17 05:30:42 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:43 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:43 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 is being set with open permissions: ugo+rw Jul 17 05:30:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:43 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 Jul 17 05:30:43 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:43 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:43 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.info Jul 17 05:30:43 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:43 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.info" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:43 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.info is being set with open permissions: ugo+rw Jul 17 05:30:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:43 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.info Jul 17 05:30:43 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:44 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.info" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.079s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Creating offline snapshot 41d2cc3e-8878-4f76-aed4-13120b568ebb of volume 7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:30:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0d16612a-74c8-4304-b9c2-39966ef65514 tempest-VolumesSnapshotListTestJSON-1892255116 None] Create snapshot completed successfully Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc6d74-5a7e-4615-87c3-221b7fc53c68]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:44 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 Jul 17 05:30:44 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:44 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5" returned: 0 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:44 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb 1G Jul 17 05:30:44 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:45 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb 1G" returned: 0 in 0.564s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:45 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb Jul 17 05:30:45 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:45 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:45 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:30:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:45 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb Jul 17 05:30:45 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:46 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:46 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.info Jul 17 05:30:46 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7f15b2ab-2e5c-401b-8d31-0f0d673cd4b7 req-87d78ec9-e1df-41bd-bb71-a9e08663924f tempest-ServerActionsTestOtherA-595841764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:46 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.info" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:46 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:46 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.info Jul 17 05:30:46 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:46 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.info" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.444s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.849s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Creating offline snapshot b1f41351-5935-487c-abcb-18f1fa96e9e2 of volume e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[886a4f5d-4885-49d8-bb4e-20a8240fa401]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2194fcb0-d6a6-46c0-af27-39ad96df1207 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dc078e17-e099-4eeb-9835-1b96199d832f: created successfully Jul 17 05:30:46 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 Jul 17 05:30:46 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:47 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24" returned: 0 in 0.394s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:47 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 1G Jul 17 05:30:47 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dc078e17-e099-4eeb-9835-1b96199d832f: deleting Jul 17 05:30:47 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 1G" returned: 0 in 0.514s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dc078e17-e099-4eeb-9835-1b96199d832f: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 05:30:47 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 Jul 17 05:30:47 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-7fd01e8e-6e86-4db5-aff6-197e452d47e5" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-7fd01e8e-6e86-4db5-aff6-197e452d47e5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-41d2cc3e-8878-4f76-aed4-13120b568ebb" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-41d2cc3e-8878-4f76-aed4-13120b568ebb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Deleting offline snapshot 41d2cc3e-8878-4f76-aed4-13120b568ebb of volume 7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] snapshot_file for this snap is: volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478119e-4e11-4b0b-9334-93f89141e46c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:48 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb Jul 17 05:30:48 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:48 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2" returned: 0 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:48 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 is being set with open permissions: ugo+rw Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:48 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 Jul 17 05:30:48 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:48 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb" returned: 0 in 0.427s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70fafdf-421e-4d25-ad23-8d1b1141c1ca]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:48 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2" returned: 0 in 0.270s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.680s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7f15b2ab-2e5c-401b-8d31-0f0d673cd4b7 req-87d78ec9-e1df-41bd-bb71-a9e08663924f tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.201s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7f15b2ab-2e5c-401b-8d31-0f0d673cd4b7 req-87d78ec9-e1df-41bd-bb71-a9e08663924f tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cafc4abb-34fb-4d56-ad48-122a40288309 tempest-VolumesSnapshotListTestJSON-1892255116 None] Create snapshot completed successfully Jul 17 05:30:48 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 Jul 17 05:30:48 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-7f15b2ab-2e5c-401b-8d31-0f0d673cd4b7 req-87d78ec9-e1df-41bd-bb71-a9e08663924f tempest-ServerActionsTestOtherA-595841764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a01796c-60ca-477d-94d1-67243372748d', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:30:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-7f15b2ab-2e5c-401b-8d31-0f0d673cd4b7 req-87d78ec9-e1df-41bd-bb71-a9e08663924f tempest-ServerActionsTestOtherA-595841764 None] attachment_update completed successfully. Jul 17 05:30:48 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:48 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb Jul 17 05:30:48 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:49 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb" returned: 0 in 0.470s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:49 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb Jul 17 05:30:49 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Creating offline snapshot 5f796255-3081-407e-885c-8f990a70933f of volume e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[49489617-ed8f-4eed-9e49-c6002f32cf17]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:49 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5.41d2cc3e-8878-4f76-aed4-13120b568ebb" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:49 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 Jul 17 05:30:49 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-41d2cc3e-8878-4f76-aed4-13120b568ebb" released by "_delete_snapshot" :: held 1.850s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-7fd01e8e-6e86-4db5-aff6-197e452d47e5" released by "delete_snapshot" :: held 1.889s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:49 devstack cinder-volume[87750]: WARNING cinder.quota [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1919239768 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1919239768, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:49 devstack cinder-volume[87750]: WARNING cinder.quota [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1919239768 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1919239768, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:49 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['7ca222cc-8fb6-4cfe-b8cc-8598d4572af7', 'b1c662d6-35f7-4f39-806d-12314aba5ab8', '16d73be7-3cfc-4e70-ab8a-72a1b60cbe89', '50c178c6-99ac-4bab-a430-bb3e26cd19c0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f547094d-0a4e-4176-a94a-961a126ab3a8 tempest-GroupSnapshotsTest-1874375933 None] group_snapshot dc078e17-e099-4eeb-9835-1b96199d832f: deleted successfully Jul 17 05:30:50 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2" returned: 0 in 0.557s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:50 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f 1G Jul 17 05:30:50 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "cinder-quobyte-7fd01e8e-6e86-4db5-aff6-197e452d47e5" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-7fd01e8e-6e86-4db5-aff6-197e452d47e5" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a42a2af-f2f6-45cf-88de-f2976c834d65]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:50 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 Jul 17 05:30:50 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:50 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f 1G" returned: 0 in 0.881s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:50 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f Jul 17 05:30:50 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:51 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5" returned: 0 in 0.489s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:51 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5 Jul 17 05:30:51 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:51 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f" returned: 0 in 0.332s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:51 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f is being set with open permissions: ugo+rw Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:51 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f Jul 17 05:30:51 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:51 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7fd01e8e-6e86-4db5-aff6-197e452d47e5" returned: 0 in 0.331s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Lock "cinder-quobyte-7fd01e8e-6e86-4db5-aff6-197e452d47e5" released by "delete_volume" :: held 0.916s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:51 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['51318f1e-534e-4623-a27f-0c517b78644c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:51 devstack cinder-volume[87750]: WARNING cinder.quota [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1919239768 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1919239768, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:30:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-835b986a-e42d-4db3-8e65-6b47e998fe9f tempest-VolumesSnapshotListTestJSON-1892255116 None] Create snapshot completed successfully Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Created reservations ['b775862a-35af-4bb4-8c8b-454fc783a6d4', 'e6c24bbe-ba2c-4941-aaad-1b23afa4c847', '67e85951-e0a8-477b-867a-7feabfb74f63', '2caf5780-9c10-46a3-81ed-7cdb7e2c2393'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:51 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:51 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-b8e574a0-e65c-4772-b10e-36db87863c4a req-8082a48b-98be-438f-8dbc-919c0f31ce41 tempest-ServerActionsTestOtherA-595841764 None] Terminate volume connection completed successfully. Jul 17 05:30:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-b8e574a0-e65c-4772-b10e-36db87863c4a req-8082a48b-98be-438f-8dbc-919c0f31ce41 tempest-ServerActionsTestOtherA-595841764 None] Deleting attachment 9a01796c-60ca-477d-94d1-67243372748d. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:30:52 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4ea1d800-d288-4956-8b99-d53154d112ab tempest-GroupSnapshotsTest-1874375933 None] Delete group completed successfully. Jul 17 05:30:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-b8e574a0-e65c-4772-b10e-36db87863c4a req-2b9ce098-9540-4824-a4e3-303bf7746b3e tempest-ServerActionsTestOtherA-595841764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-b8e574a0-e65c-4772-b10e-36db87863c4a req-2b9ce098-9540-4824-a4e3-303bf7746b3e tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:53 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=147,cinder:SELECT=159,cinder:DELETE=7,cinder:INSERT=37 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:30:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-b8e574a0-e65c-4772-b10e-36db87863c4a req-2b9ce098-9540-4824-a4e3-303bf7746b3e tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-b8e574a0-e65c-4772-b10e-36db87863c4a req-2b9ce098-9540-4824-a4e3-303bf7746b3e tempest-ServerActionsTestOtherA-595841764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd968afc7-863c-4965-a0b8-7755befda6f3', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:30:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-b8e574a0-e65c-4772-b10e-36db87863c4a req-2b9ce098-9540-4824-a4e3-303bf7746b3e tempest-ServerActionsTestOtherA-595841764 None] attachment_update completed successfully. Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-5f796255-3081-407e-885c-8f990a70933f-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-5f796255-3081-407e-885c-8f990a70933f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-quobyte-5f796255-3081-407e-885c-8f990a70933f" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-5f796255-3081-407e-885c-8f990a70933f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Deleting offline snapshot 5f796255-3081-407e-885c-8f990a70933f of volume e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] snapshot_file for this snap is: volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa16aaa8-c3f5-4ce3-900e-693e91677a64]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:54 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f Jul 17 05:30:54 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f" returned: 0 in 0.708s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:55 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[251911de-f081-49bb-aeda-4adc1cec0766]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:55 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 Jul 17 05:30:55 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:56 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2" returned: 0 in 0.964s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:56 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f Jul 17 05:30:56 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:56 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:30:56 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:56 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:30:56 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f" returned: 0 in 0.848s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:57 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f Jul 17 05:30:57 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:57 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.5f796255-3081-407e-885c-8f990a70933f" returned: 0 in 0.580s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-5f796255-3081-407e-885c-8f990a70933f" released by "_delete_snapshot" :: held 3.319s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" released by "delete_snapshot" :: held 3.364s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:57 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Created reservations ['4a019f8a-e177-4dc9-b912-dcb0ae068610', '7b0d8986-a298-4e79-8829-48b1624ba3d6', 'b167a92b-d91e-420e-a6ea-5f37adb1c94b', '0d7d7809-e959-40ce-b9fb-795f4419d388'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:30:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Delete snapshot completed successfully. Jul 17 05:30:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6ed79f81-c991-479d-b078-407c3a903afb tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-5f796255-3081-407e-885c-8f990a70933f-delete_snapshot" released by "delete_snapshot" :: held 3.609s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-b1f41351-5935-487c-abcb-18f1fa96e9e2-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-b1f41351-5935-487c-abcb-18f1fa96e9e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-quobyte-b1f41351-5935-487c-abcb-18f1fa96e9e2" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-b1f41351-5935-487c-abcb-18f1fa96e9e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Deleting offline snapshot b1f41351-5935-487c-abcb-18f1fa96e9e2 of volume e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] snapshot_file for this snap is: volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7600081-6f05-4510-958e-6566746d459a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:59 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 Jul 17 05:30:59 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:59 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67d7a98-0e62-49af-8569-78c9e5313b18]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:30:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:59 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 Jul 17 05:30:59 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:30:59 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 17 05:30:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:30:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:30:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:30:59 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 Jul 17 05:30:59 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dbdf0ee0-b5fa-4dba-a84c-e90d605d096d tempest-GroupSnapshotsV319Test-852318229 None] Group tempest-GroupSnapshotsV319Test-Group-1201889884: creating Jul 17 05:31:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dbdf0ee0-b5fa-4dba-a84c-e90d605d096d tempest-GroupSnapshotsV319Test-852318229 None] Group tempest-GroupSnapshotsV319Test-Group-1201889884: created successfully Jul 17 05:31:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dbdf0ee0-b5fa-4dba-a84c-e90d605d096d tempest-GroupSnapshotsV319Test-852318229 None] Create group completed successfully. Jul 17 05:31:00 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2" returned: 0 in 0.542s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:00 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2 Jul 17 05:31:00 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:00 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.b1f41351-5935-487c-abcb-18f1fa96e9e2" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-b1f41351-5935-487c-abcb-18f1fa96e9e2" released by "_delete_snapshot" :: held 1.712s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" released by "delete_snapshot" :: held 1.740s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Created reservations ['55bf8337-fc22-4788-855d-786e4e47634b', '79019fb7-328a-4142-b1e9-0d5b7a0e6f28', '3e4bc6eb-db72-4eee-b9f3-99f24bb4d2d8', '2b461a1b-094e-4145-b68a-5c9ba43daa1b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Delete snapshot completed successfully. Jul 17 05:31:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8856d64-c1e1-488d-9c1d-4fd7e35127a6 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-b1f41351-5935-487c-abcb-18f1fa96e9e2-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-d2315d3a-fe23-4da4-94f4-16b7475fef24-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-d2315d3a-fe23-4da4-94f4-16b7475fef24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-quobyte-d2315d3a-fe23-4da4-94f4-16b7475fef24" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-d2315d3a-fe23-4da4-94f4-16b7475fef24" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Deleting offline snapshot d2315d3a-fe23-4da4-94f4-16b7475fef24 of volume e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] snapshot_file for this snap is: volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df175c-5f6c-42ec-9f5b-ff3001d102ff]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:01 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 Jul 17 05:31:01 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:01 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6814e79-7bc5-421f-b7aa-98655bcdd3da]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:01 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 Jul 17 05:31:01 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Flow 'volume_create_manager' (7bb50286-d98f-493e-b3e3-de8b1223eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a168ca3e-2487-4af3-a745-0e6fda7bf09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a168ca3e-2487-4af3-a745-0e6fda7bf09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-470087221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=736282a7-015d-4abd-ac23-9f1afe43003d,host='devstack@QuobyteHD#QuobyteHD',id=51dcc2d7-324d-4cd8-9dba-d29742936557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d61faf0d827418cbc3d44a9388a1d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:31:02Z,use_quota=True,user_id='405b0a387cda4645996e0ead859dfc20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bdccacc-fe9c-4783-98b5-30c5505a7484),volume_type_id=4bdccacc-fe9c-4783-98b5-30c5505a7484)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0885635-b06a-42b0-899e-0aca97ca3ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0885635-b06a-42b0-899e-0aca97ca3ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80054c7-7cbe-4089-8d48-e56d9f878433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:02 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80054c7-7cbe-4089-8d48-e56d9f878433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dcc2d7-324d-4cd8-9dba-d29742936557', 'volume_name': 'volume-51dcc2d7-324d-4cd8-9dba-d29742936557', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a9811d-3df4-4ebf-88f4-eebb9ca00253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a9811d-3df4-4ebf-88f4-eebb9ca00253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2936974-8278-491c-850d-45a7f6168315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Volume 51dcc2d7-324d-4cd8-9dba-d29742936557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dcc2d7-324d-4cd8-9dba-d29742936557', 'volume_size': 1} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=736282a7-015d-4abd-ac23-9f1afe43003d,created_at=2026-07-17T03:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-470087221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=736282a7-015d-4abd-ac23-9f1afe43003d,host='devstack@QuobyteHD#QuobyteHD',id=51dcc2d7-324d-4cd8-9dba-d29742936557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d61faf0d827418cbc3d44a9388a1d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:31:02Z,use_quota=True,user_id='405b0a387cda4645996e0ead859dfc20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bdccacc-fe9c-4783-98b5-30c5505a7484),volume_type_id=4bdccacc-fe9c-4783-98b5-30c5505a7484)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Creating volume 51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:31:02 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709" returned: 0 in 0.480s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:02 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 1073741824 Jul 17 05:31:02 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:02 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 Jul 17 05:31:02 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:02 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:02 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24 Jul 17 05:31:02 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:02 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 1073741824" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:02 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 Jul 17 05:31:02 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:02 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709.d2315d3a-fe23-4da4-94f4-16b7475fef24" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-d2315d3a-fe23-4da4-94f4-16b7475fef24" released by "_delete_snapshot" :: held 1.652s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" released by "delete_snapshot" :: held 1.678s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:02 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2936974-8278-491c-850d-45a7f6168315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dcc2d7-324d-4cd8-9dba-d29742936557', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68a5d86-ede5-4695-96fe-b347e77342ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Created reservations ['0c3ce713-1f5b-43f5-b19e-eb4e86bdfd68', 'e52b64cb-4b0e-448f-9100-dfef96a0daa0', '74204327-3367-48df-bfd7-3d8a0350d602', '7db87395-9190-4365-9892-47c5c675d2eb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Volume volume-51dcc2d7-324d-4cd8-9dba-d29742936557 (51dcc2d7-324d-4cd8-9dba-d29742936557): created successfully Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68a5d86-ede5-4695-96fe-b347e77342ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Flow 'volume_create_manager' (7bb50286-d98f-493e-b3e3-de8b1223eaff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:31:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f74cda4a-20c0-4d77-af14-fa770771b91c tempest-GroupSnapshotsV319Test-852318229 None] Created volume successfully. Jul 17 05:31:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Delete snapshot completed successfully. Jul 17 05:31:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dd38f882-afb4-4ef8-80d2-8445ca79f80f tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-d2315d3a-fe23-4da4-94f4-16b7475fef24-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-e84fb882-633d-4dba-a8cb-b7e59f8f9709-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-e84fb882-633d-4dba-a8cb-b7e59f8f9709-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] GroupSnapshot 04003dc6-5745-4e01-b833-ff6df1623aae: creating. Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32f272a-7573-41f1-bcfb-a12630b96cb3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Group snapshot 04003dc6-5745-4e01-b833-ff6df1623aae: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Creating offline snapshot bfb14149-5cae-46b6-8cf2-0a028477ee90 of volume 51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1199e8-08a9-47de-a111-5ec36dd8dd02]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:03 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 Jul 17 05:31:03 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:03 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 Jul 17 05:31:03 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:03 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709" returned: 0 in 0.519s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:04 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709 Jul 17 05:31:04 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:04 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557" returned: 0 in 0.498s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:04 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 1G Jul 17 05:31:04 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:04 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e84fb882-633d-4dba-a8cb-b7e59f8f9709" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-quobyte-e84fb882-633d-4dba-a8cb-b7e59f8f9709" released by "delete_volume" :: held 0.957s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Created reservations ['b52f43fa-be43-4ddf-b976-5d30d97a2206', '6fefb4c4-77b7-4889-a2d3-809ff987e022', 'b2768ad2-819f-4e8f-bbc7-e0e0c956630f', 'ddfa288a-bb15-45de-9eab-109ddf0060a5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:04 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:31:04 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:04 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 1G" returned: 0 in 0.582s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51dcc2d7-324d-4cd8-9dba-d29742936557 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:04 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51dcc2d7-324d-4cd8-9dba-d29742936557 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 Jul 17 05:31:04 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:04 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:31:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Deleted volume successfully. Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1ccc9e02-3d4e-4b6a-8998-fc8c07689b37 tempest-VolumesSnapshotListTestJSON-1892255116 None] Lock "cinder-e84fb882-633d-4dba-a8cb-b7e59f8f9709-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:04 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51dcc2d7-324d-4cd8-9dba-d29742936557 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:04 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:31:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:05 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 Jul 17 05:31:05 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:05 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:05 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.info Jul 17 05:31:05 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:05 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.info" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:05 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:31:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:05 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.info Jul 17 05:31:05 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:05 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.info" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-61d63d2b-1d02-4e1e-9e4e-be002f1dcf37 req-26244473-9ebc-4424-a561-74bc9830df8c tempest-AttachVolumeTestJSON-412024937 None] Terminate volume connection completed successfully. Jul 17 05:31:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-61d63d2b-1d02-4e1e-9e4e-be002f1dcf37 req-26244473-9ebc-4424-a561-74bc9830df8c tempest-AttachVolumeTestJSON-412024937 None] Deleting attachment bdb88ad5-babe-4892-bab6-20268b210a76. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:31:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3a193ba6-48a9-4892-8014-a1f84a6d0630 tempest-GroupSnapshotsV319Test-852318229 None] group_snapshot 04003dc6-5745-4e01-b833-ff6df1623aae: created successfully Jul 17 05:31:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] group_snapshot 04003dc6-5745-4e01-b833-ff6df1623aae: deleting Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] group_snapshot 04003dc6-5745-4e01-b833-ff6df1623aae: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Acquiring lock "cinder-quobyte-51dcc2d7-324d-4cd8-9dba-d29742936557" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Lock "cinder-quobyte-51dcc2d7-324d-4cd8-9dba-d29742936557" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Acquiring lock "cinder-quobyte-bfb14149-5cae-46b6-8cf2-0a028477ee90" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Lock "cinder-quobyte-bfb14149-5cae-46b6-8cf2-0a028477ee90" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Deleting offline snapshot bfb14149-5cae-46b6-8cf2-0a028477ee90 of volume 51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] snapshot_file for this snap is: volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f414a0c2-91e1-4a3f-9a7b-d82742e05462]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:07 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 Jul 17 05:31:07 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:08 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90" returned: 0 in 0.488s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51dcc2d7-324d-4cd8-9dba-d29742936557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[95329f4a-bf91-43be-a0c2-7164ffc04237]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:08 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 Jul 17 05:31:08 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:08 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:08 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 Jul 17 05:31:08 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:09 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90" returned: 0 in 0.702s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:09 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90 Jul 17 05:31:09 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:09 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557.bfb14149-5cae-46b6-8cf2-0a028477ee90" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Lock "cinder-quobyte-bfb14149-5cae-46b6-8cf2-0a028477ee90" released by "_delete_snapshot" :: held 2.121s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Lock "cinder-quobyte-51dcc2d7-324d-4cd8-9dba-d29742936557" released by "delete_snapshot" :: held 2.154s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:09 devstack cinder-volume[87750]: WARNING cinder.quota [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1294893526 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1294893526, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:31:09 devstack cinder-volume[87750]: WARNING cinder.quota [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1294893526 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1294893526, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:31:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] Created reservations ['f2ef64c6-5fff-4624-8afe-7f380770afba', 'e70e8ebd-193b-4e8e-8519-0c4416be7ba0', 'dca8ec78-f948-4b21-94f5-791023ec903b', '7e71596d-8609-493b-9b1c-d47af22c896c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-470883e5-edfb-41c1-9510-daf6774f46c3 tempest-GroupSnapshotsV319Test-852318229 None] group_snapshot 04003dc6-5745-4e01-b833-ff6df1623aae: deleted successfully Jul 17 05:31:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Acquiring lock "cinder-quobyte-51dcc2d7-324d-4cd8-9dba-d29742936557" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Lock "cinder-quobyte-51dcc2d7-324d-4cd8-9dba-d29742936557" acquired by "delete_volume" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a46752-85ae-4359-9e73-4acbc16fb94d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:10 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 Jul 17 05:31:10 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:11 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557" returned: 0 in 0.597s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:11 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557 Jul 17 05:31:11 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:11 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-51dcc2d7-324d-4cd8-9dba-d29742936557" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Lock "cinder-quobyte-51dcc2d7-324d-4cd8-9dba-d29742936557" released by "delete_volume" :: held 1.115s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:11 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Created reservations ['ac22a2d3-913a-475e-8d9b-36eea4c307fe'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:11 devstack cinder-volume[87750]: WARNING cinder.quota [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1294893526 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1294893526, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Created reservations ['1ac40c38-c57f-4924-aa75-80db2cda18ea', '601b45ac-b13e-4e00-b221-6b7c2e4381bd', '3d0cfa6f-41a5-41d5-9355-42ff2303268e', '87da8b16-8dbc-4fb0-9a55-69d3076915e7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:12 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:31:12 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:12 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:31:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bd3de914-a625-450a-aa9c-db513b204143 tempest-GroupSnapshotsV319Test-852318229 None] Delete group completed successfully. Jul 17 05:31:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:31:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Flow 'volume_create_manager' (d160f066-461a-4e16-832a-fd43c6e9912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:31:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf3144b-89de-4f8f-975f-ecc9bf100d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf3144b-89de-4f8f-975f-ecc9bf100d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1007013063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb01ce6da6e47908d14eec8ec0ad4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:31:21Z,use_quota=True,user_id='9590b985658242c1b64c54f907f08765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de15bdf-0e37-4d20-86eb-cbdddc4391e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de15bdf-0e37-4d20-86eb-cbdddc4391e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0cfeab-6051-43b5-8344-4a0eedb8b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0cfeab-6051-43b5-8344-4a0eedb8b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6', 'volume_name': 'volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edabc82-5b5c-4c55-b7d7-1eeddaf0ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edabc82-5b5c-4c55-b7d7-1eeddaf0ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3058dd11-179d-4901-9525-64fb60207d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6', 'volume_size': 1} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1007013063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb01ce6da6e47908d14eec8ec0ad4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:31:21Z,use_quota=True,user_id='9590b985658242c1b64c54f907f08765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Creating volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:31:21 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:21 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 1073741824 Jul 17 05:31:21 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:21 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 1073741824" returned: 0 in 0.699s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:21 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 Jul 17 05:31:21 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:22 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:31:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3058dd11-179d-4901-9525-64fb60207d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3735e47c-265d-4e70-be44-da6abaf1d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Volume volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 (c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6): created successfully Jul 17 05:31:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3735e47c-265d-4e70-be44-da6abaf1d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Flow 'volume_create_manager' (d160f066-461a-4e16-832a-fd43c6e9912a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:31:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-29e22408-7137-458f-8f51-ea005f2b05a7 tempest-SnapshotsActionsTest-80273089 None] Created volume successfully. Jul 17 05:31:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Creating offline snapshot b803805a-053d-4605-8359-9fa36288ed92 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:31:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad62f5f7-4636-40eb-b578-0f81a9d98a4b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:23 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 Jul 17 05:31:23 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:23 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" returned: 0 in 0.447s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:23 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 1G Jul 17 05:31:23 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:24 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 1G" returned: 0 in 0.521s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:24 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:24 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:24 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:24 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 is being set with open permissions: ugo+rw Jul 17 05:31:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:24 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:24 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:24 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:24 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=142,cinder:UPDATE=141,cinder:INSERT=37,cinder:DELETE=6 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:31:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:24 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.info Jul 17 05:31:24 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:25 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.info" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:25 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.info is being set with open permissions: ugo+rw Jul 17 05:31:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:25 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.info Jul 17 05:31:25 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:25 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.info" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e773ffab-679b-4f59-8070-e3acfcef961c tempest-SnapshotsActionsTest-80273089 None] Create snapshot completed successfully Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Creating offline snapshot 71019180-1957-4dc6-997d-d289687842e8 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f77b1-3281-4138-9322-282bb4f95aa4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:27 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:27 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:27 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:27 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 1G Jul 17 05:31:27 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:27 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 1G" returned: 0 in 0.453s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:28 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 Jul 17 05:31:28 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:28 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 is being set with open permissions: ugo+rw Jul 17 05:31:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:28 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 Jul 17 05:31:28 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:28 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.540s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3106977a-c8da-447f-b067-2bb8907161b3 tempest-SnapshotsActionsTest-80273089 None] Create snapshot completed successfully Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-71019180-1957-4dc6-997d-d289687842e8-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-71019180-1957-4dc6-997d-d289687842e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-71019180-1957-4dc6-997d-d289687842e8" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-71019180-1957-4dc6-997d-d289687842e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Deleting offline snapshot 71019180-1957-4dc6-997d-d289687842e8 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] snapshot_file for this snap is: volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3305c3-ba0c-44a0-978b-e52231ffaa3f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:29 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 Jul 17 05:31:29 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:29 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8" returned: 0 in 0.398s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e5c0ff-74f1-4680-a644-ea3fb90fa5e4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:30 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:30 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:30 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:30 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 Jul 17 05:31:30 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:30 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:30 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8 Jul 17 05:31:30 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:31 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.71019180-1957-4dc6-997d-d289687842e8" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-71019180-1957-4dc6-997d-d289687842e8" released by "_delete_snapshot" :: held 1.629s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" released by "delete_snapshot" :: held 1.661s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Created reservations ['946f3dcd-186d-47de-b326-e9748bd44606', '21d8b3e1-fcaf-4415-a61a-3c45c5f85b96', '496c4eb1-f33a-44f3-958f-d238d161ebcb', 'fc10c8fb-077a-40d0-99a6-e6f331b782ce'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Delete snapshot completed successfully. Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7bad51f1-3a6b-4270-bb48-d2af43e7f9a9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-71019180-1957-4dc6-997d-d289687842e8-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Creating offline snapshot 310fb4c6-6418-4cb0-9e53-eeddd413b8ce of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a4ee2f-2991-4eff-b40c-6f75bccec948]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:32 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:32 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:32 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.415s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:32 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce 1G Jul 17 05:31:32 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:33 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce 1G" returned: 0 in 0.651s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:33 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce Jul 17 05:31:33 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:33 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:33 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce is being set with open permissions: ugo+rw Jul 17 05:31:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:33 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce Jul 17 05:31:33 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:33 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-48a11b29-74dc-4341-b1fd-bd24470a6448 tempest-SnapshotsActionsTest-80273089 None] Create snapshot completed successfully Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-310fb4c6-6418-4cb0-9e53-eeddd413b8ce-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-310fb4c6-6418-4cb0-9e53-eeddd413b8ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-310fb4c6-6418-4cb0-9e53-eeddd413b8ce" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-310fb4c6-6418-4cb0-9e53-eeddd413b8ce" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Deleting offline snapshot 310fb4c6-6418-4cb0-9e53-eeddd413b8ce of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] snapshot_file for this snap is: volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c215f442-3714-46e7-b09f-4145e97f9b43]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:34 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce Jul 17 05:31:34 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:34 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce" returned: 0 in 0.616s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4e99c-4ee9-48cf-911e-e0ff96cf4f6c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:35 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:35 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:35 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.542s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:35 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce Jul 17 05:31:35 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-a1748787-5d56-4078-ab22-75602c32b8c4 req-2d793179-f700-4598-9798-35141be094b8 tempest-ServerActionsTestOtherA-595841764 None] Terminate volume connection completed successfully. Jul 17 05:31:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-a1748787-5d56-4078-ab22-75602c32b8c4 req-2d793179-f700-4598-9798-35141be094b8 tempest-ServerActionsTestOtherA-595841764 None] Deleting attachment d968afc7-863c-4965-a0b8-7755befda6f3. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:31:36 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce" returned: 0 in 0.621s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:36 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce Jul 17 05:31:36 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:36 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.310fb4c6-6418-4cb0-9e53-eeddd413b8ce" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-310fb4c6-6418-4cb0-9e53-eeddd413b8ce" released by "_delete_snapshot" :: held 2.242s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" released by "delete_snapshot" :: held 2.270s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Created reservations ['ffcdd4b1-4f61-4ff4-80ea-6c0fdb6a38cd', '5005c10b-d718-4f81-8231-2ad086bb7fa2', 'b96d8148-5b7d-49f0-9829-4761cd00e09d', 'e647f66b-d7ef-4af2-b3fc-b1718881ab7a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Delete snapshot completed successfully. Jul 17 05:31:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70e9cef9-8daa-4732-abe0-a038e3d08c48 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-310fb4c6-6418-4cb0-9e53-eeddd413b8ce-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Creating offline snapshot 21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab543b-f6e4-48c6-81e3-019135fab422]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:38 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:38 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:38 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.583s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:38 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 1G Jul 17 05:31:38 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:39 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 1G" returned: 0 in 0.677s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:39 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 Jul 17 05:31:39 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:39 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" returned: 0 in 0.412s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:39 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 is being set with open permissions: ugo+rw Jul 17 05:31:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:39 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 Jul 17 05:31:39 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:40 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e0b47e18-2e20-438e-bb81-caf118365424 tempest-SnapshotsActionsTest-80273089 None] Create snapshot completed successfully Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Acquiring lock "cinder-6f76eb5e-65b9-427c-a0d3-98cfb66e0637-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Lock "cinder-6f76eb5e-65b9-427c-a0d3-98cfb66e0637-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Acquiring lock "cinder-quobyte-6f76eb5e-65b9-427c-a0d3-98cfb66e0637" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Lock "cinder-quobyte-6f76eb5e-65b9-427c-a0d3-98cfb66e0637" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fdc1fd-7455-4e39-b0d9-6533a86dc6e4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Deleting offline snapshot 21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] snapshot_file for this snap is: volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:31:41 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 Jul 17 05:31:41 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc941a8-fe40-4e63-aed1-000f3071586f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:41 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 Jul 17 05:31:41 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:42 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637" returned: 0 in 0.628s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:42 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:42 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637 Jul 17 05:31:42 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b294f090-0ec2-4119-b454-53e447bce4cb]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:42 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:42 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:42 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f76eb5e-65b9-427c-a0d3-98cfb66e0637" returned: 0 in 0.569s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Lock "cinder-quobyte-6f76eb5e-65b9-427c-a0d3-98cfb66e0637" released by "delete_volume" :: held 1.266s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Created reservations ['b723a5f7-8575-4409-8dd1-b0f100c30db9', '8de40790-70f9-4309-83eb-8013f9edbe2d', 'a918660e-0293-4990-ba93-c6f69d9cd6fd', '165053af-572c-4858-a980-aaa4b6b02588'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:42 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.708s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:43 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 Jul 17 05:31:43 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:43 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:31:43 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:43 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.478s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:31:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Deleted volume successfully. Jul 17 05:31:43 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" returned: 0 in 0.610s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-10f844cc-8b4c-45a2-a173-9ffed1a3cda4 tempest-ServerActionsTestOtherA-595841764 None] Lock "cinder-6f76eb5e-65b9-427c-a0d3-98cfb66e0637-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:43 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0 Jul 17 05:31:43 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:44 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0" released by "_delete_snapshot" :: held 2.482s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" released by "delete_snapshot" :: held 2.521s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:44 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Created reservations ['35c92d3a-2c79-4346-9f0d-5f3f93fe7f1b', '5929b5c8-7e66-4b64-a088-f62d4392aeab', '551c97e7-ed9a-4f7d-845f-56a1004437d5', '18893e8a-76c5-4fb5-845a-2af70af5d935'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Delete snapshot completed successfully. Jul 17 05:31:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11e99933-7ce6-44f3-a7e2-b394338e8958 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-21fe6176-c0b9-4e8c-9279-bf3d36d7aeb0-delete_snapshot" released by "delete_snapshot" :: held 2.775s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Creating offline snapshot 8ff3340d-8115-46a8-a6a1-7f371b7b9b23 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[da48f6d7-9185-4ac8-a76a-144c1065fa5d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:45 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:45 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:45 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.478s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:45 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 1G Jul 17 05:31:45 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:46 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 1G" returned: 0 in 0.692s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:46 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 Jul 17 05:31:46 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:47 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23" returned: 0 in 0.671s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:47 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 is being set with open permissions: ugo+rw Jul 17 05:31:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:47 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 Jul 17 05:31:47 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:47 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23" returned: 0 in 0.681s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b43988e8-5a57-4bd1-b1a1-3567afd3153a tempest-SnapshotsActionsTest-80273089 None] Create snapshot completed successfully Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-8ff3340d-8115-46a8-a6a1-7f371b7b9b23-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-8ff3340d-8115-46a8-a6a1-7f371b7b9b23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Acquiring lock "cinder-quobyte-8ff3340d-8115-46a8-a6a1-7f371b7b9b23" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-8ff3340d-8115-46a8-a6a1-7f371b7b9b23" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Deleting offline snapshot 8ff3340d-8115-46a8-a6a1-7f371b7b9b23 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] snapshot_file for this snap is: volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429b314-6aff-4a56-8b07-13429a6d315e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:49 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 Jul 17 05:31:49 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:49 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23" returned: 0 in 0.887s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a108c35-6000-4121-874a-c181d30c54be]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:50 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:50 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:50 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:50 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 Jul 17 05:31:50 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:51 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23" returned: 0 in 0.620s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:51 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23 Jul 17 05:31:51 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:51 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.8ff3340d-8115-46a8-a6a1-7f371b7b9b23" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-8ff3340d-8115-46a8-a6a1-7f371b7b9b23" released by "_delete_snapshot" :: held 2.673s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" released by "delete_snapshot" :: held 2.756s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Created reservations ['6a056d34-0e20-43e8-80bd-3771a18a12a2', '9db2e88d-9f55-419f-b16d-27e218592a7f', '41e40531-69cb-4190-89aa-b6e810aa661d', '17fe3678-40b3-4fb4-89fa-5ba33cdaba89'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Delete snapshot completed successfully. Jul 17 05:31:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-776e785d-f132-4bdb-b7ce-35ea6e5ca5d9 tempest-SnapshotsActionsTest-1475524004 None] Lock "cinder-8ff3340d-8115-46a8-a6a1-7f371b7b9b23-delete_snapshot" released by "delete_snapshot" :: held 3.053s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "cinder-b803805a-053d-4605-8359-9fa36288ed92-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-b803805a-053d-4605-8359-9fa36288ed92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "cinder-quobyte-b803805a-053d-4605-8359-9fa36288ed92" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-quobyte-b803805a-053d-4605-8359-9fa36288ed92" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Deleting offline snapshot b803805a-053d-4605-8359-9fa36288ed92 of volume c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] snapshot_file for this snap is: volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa32178-621a-4d4d-aa6e-04894b96dcfd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:52 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:52 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:53 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.516s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:31:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86280e5-b17f-466d-adcd-16e9bcb9f0fc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:53 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 Jul 17 05:31:53 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:54 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" returned: 0 in 1.102s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:54 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:54 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:55 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 1.025s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:55 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92 Jul 17 05:31:55 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=83,cinder:SELECT=99,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:31:56 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Flow 'volume_create_manager' (eea0aa53-57bf-458b-9c17-6134e0e4d7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3c87b9-e665-4de6-be7b-54c451ee29c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:56 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6.b803805a-053d-4605-8359-9fa36288ed92" returned: 0 in 0.980s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:56 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3c87b9-e665-4de6-be7b-54c451ee29c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-681155219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d67543d-ed33-4bde-a8f9-bcb0ac6294f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d1dff349234cef9f8ab9e796a5e8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:31:56Z,use_quota=True,user_id='73bbb5bd6cb240a087f7b1329979f1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cbbeb2-828a-4a9f-9ac2-40396eede898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cbbeb2-828a-4a9f-9ac2-40396eede898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf611d7-d329-41aa-bd70-3aa23281beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf611d7-d329-41aa-bd70-3aa23281beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d67543d-ed33-4bde-a8f9-bcb0ac6294f2', 'volume_name': 'volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08746c1f-6586-4d27-92c1-e4e4710b3b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08746c1f-6586-4d27-92c1-e4e4710b3b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af10871a-d968-48bb-a5fa-fbbf0a122d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Volume 8d67543d-ed33-4bde-a8f9-bcb0ac6294f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2', 'volume_size': 1} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-681155219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d67543d-ed33-4bde-a8f9-bcb0ac6294f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d1dff349234cef9f8ab9e796a5e8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:31:56Z,use_quota=True,user_id='73bbb5bd6cb240a087f7b1329979f1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Creating volume 8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:31:56 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:31:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:57 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:57 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 1073741824 Jul 17 05:31:57 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.664s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-quobyte-b803805a-053d-4605-8359-9fa36288ed92" released by "_delete_snapshot" :: held 4.322s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" released by "delete_snapshot" :: held 4.395s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Created reservations ['27d2b99e-1013-42e4-a865-a20721f8d829', '8bfc5018-9c52-4c78-96a6-7bac279dbcc7', 'ecdf5241-84ff-4a93-bc37-4bd3d21fb0cf', '1bcf717a-5cfb-434f-b11e-7a2f3809d36c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:31:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Delete snapshot completed successfully. Jul 17 05:31:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38534d3b-f792-441e-b98a-1e34c0de8a55 tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-b803805a-053d-4605-8359-9fa36288ed92-delete_snapshot" released by "delete_snapshot" :: held 4.765s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:31:58 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 1073741824" returned: 0 in 1.112s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:58 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 Jul 17 05:31:58 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "cinder-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" acquired by "delete_volume" :: waited 0.056s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:31:58 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2" returned: 0 in 0.858s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af10871a-d968-48bb-a5fa-fbbf0a122d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4d7068-1ed5-4760-a269-3074ce8760cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7776574-05c2-40f0-bbc7-e33132e487dc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Volume volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 (8d67543d-ed33-4bde-a8f9-bcb0ac6294f2): created successfully Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4d7068-1ed5-4760-a269-3074ce8760cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Flow 'volume_create_manager' (eea0aa53-57bf-458b-9c17-6134e0e4d7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:31:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-270e6b68-6bc6-4bca-841f-26ae1b8c75d5 tempest-TestMinimumBasicScenario-661173975 None] Created volume successfully. Jul 17 05:31:59 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 Jul 17 05:31:59 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:31:59 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" returned: 0 in 0.655s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:31:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:31:59 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6 Jul 17 05:31:59 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:00 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" returned: 0 in 0.473s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-quobyte-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6" released by "delete_volume" :: held 1.325s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Created reservations ['73541620-6741-4c52-8908-cbbd97dc978d', 'cfcd3cf4-b676-460d-bfcf-435685cce546', '818bbd09-9028-4bb5-b11e-06f3721f7e94', '127ce63a-8f1f-4a78-8d14-8f0c22320e0d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:00 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:32:00 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.529s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:00 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:32:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Deleted volume successfully. Jul 17 05:32:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b6ceeb5f-d3c4-4e2d-99d0-0587d8e0179b tempest-SnapshotsActionsTest-80273089 None] Lock "cinder-c6b9075e-8ffa-4aa8-9032-7a7804c6b6b6-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-41c8292d-2964-4a12-9270-8df3d729a0bc req-0917a707-1aa9-46be-93ae-a903c5d5f2f6 tempest-TestMinimumBasicScenario-661173975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-41c8292d-2964-4a12-9270-8df3d729a0bc req-0917a707-1aa9-46be-93ae-a903c5d5f2f6 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-41c8292d-2964-4a12-9270-8df3d729a0bc req-0917a707-1aa9-46be-93ae-a903c5d5f2f6 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-41c8292d-2964-4a12-9270-8df3d729a0bc req-0917a707-1aa9-46be-93ae-a903c5d5f2f6 tempest-TestMinimumBasicScenario-661173975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ca8a57b-5dc2-4e16-9926-9341715ebb30', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:32:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-41c8292d-2964-4a12-9270-8df3d729a0bc req-0917a707-1aa9-46be-93ae-a903c5d5f2f6 tempest-TestMinimumBasicScenario-661173975 None] attachment_update completed successfully. Jul 17 05:32:12 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:DELETE=6,cinder:SELECT=52,cinder:UPDATE=52,cinder:INSERT=15 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:32:12 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=18 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Flow 'volume_create_manager' (79be2710-1b04-4a03-a9c0-b77b408a4d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49833c95-9f34-4eb0-9046-d1e8f32201f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49833c95-9f34-4eb0-9046-d1e8f32201f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1498897475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8a1221-2dd8-425c-997d-05a1ccec56ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36d9a396a58460abb341d0f1cf76292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:21Z,use_quota=True,user_id='8abf05d1187c4cd7b81a3be5b9aeeea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5630d7f5-0d33-41b5-bdba-44891dae517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5630d7f5-0d33-41b5-bdba-44891dae517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70c4c43-d8a0-4950-bde2-09eb86fd983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70c4c43-d8a0-4950-bde2-09eb86fd983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab8a1221-2dd8-425c-997d-05a1ccec56ff', 'volume_name': 'volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c163b1-6c5a-42ce-bb58-fcc7f7f7aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c163b1-6c5a-42ce-bb58-fcc7f7f7aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d365caae-9131-4352-b7d9-4fe9ff543c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Volume ab8a1221-2dd8-425c-997d-05a1ccec56ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff', 'volume_size': 1} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1498897475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8a1221-2dd8-425c-997d-05a1ccec56ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36d9a396a58460abb341d0f1cf76292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:21Z,use_quota=True,user_id='8abf05d1187c4cd7b81a3be5b9aeeea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Creating volume ab8a1221-2dd8-425c-997d-05a1ccec56ff {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:32:21 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:21 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff 1073741824 Jul 17 05:32:21 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:21 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff 1073741824" returned: 0 in 0.577s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:21 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff Jul 17 05:32:21 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:22 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:32:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d365caae-9131-4352-b7d9-4fe9ff543c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ce9440-b962-4e36-a89d-52904b500463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Volume volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff (ab8a1221-2dd8-425c-997d-05a1ccec56ff): created successfully Jul 17 05:32:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ce9440-b962-4e36-a89d-52904b500463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Flow 'volume_create_manager' (79be2710-1b04-4a03-a9c0-b77b408a4d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f30b5c08-1ad2-4c4c-a6e8-72d4eaa49b3b tempest-AttachVolumeTestJSON-412024937 None] Created volume successfully. Jul 17 05:32:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-76e4ad5f-9354-477b-a446-aec0ac8bb81c req-89db72c1-6250-4c9a-b776-0168f9b22b6d tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-76e4ad5f-9354-477b-a446-aec0ac8bb81c req-89db72c1-6250-4c9a-b776-0168f9b22b6d tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-76e4ad5f-9354-477b-a446-aec0ac8bb81c req-89db72c1-6250-4c9a-b776-0168f9b22b6d tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-76e4ad5f-9354-477b-a446-aec0ac8bb81c req-89db72c1-6250-4c9a-b776-0168f9b22b6d tempest-AttachVolumeTestJSON-412024937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b2fcc43-bc78-431c-a6e6-a70be4a5ee67', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:32:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-76e4ad5f-9354-477b-a446-aec0ac8bb81c req-89db72c1-6250-4c9a-b776-0168f9b22b6d tempest-AttachVolumeTestJSON-412024937 None] attachment_update completed successfully. Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Flow 'volume_create_manager' (9cfc6af6-2771-4144-a074-9538937cb087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b6bc41-c1fd-4868-bed1-ff57e01afc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b6bc41-c1fd-4868-bed1-ff57e01afc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1936251911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9746a481-bbc9-4a27-9b70-108138eb259a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36d9a396a58460abb341d0f1cf76292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:28Z,use_quota=True,user_id='8abf05d1187c4cd7b81a3be5b9aeeea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da6a7d-c051-41df-be83-b6adb4291c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da6a7d-c051-41df-be83-b6adb4291c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14046aff-ae8f-4f3b-813c-af4b07457110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14046aff-ae8f-4f3b-813c-af4b07457110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9746a481-bbc9-4a27-9b70-108138eb259a', 'volume_name': 'volume-9746a481-bbc9-4a27-9b70-108138eb259a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73a060e-9bb3-4e97-acb1-47ae41eef9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73a060e-9bb3-4e97-acb1-47ae41eef9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f1c57-7c92-45e6-81b3-f3f5b05e5224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Volume 9746a481-bbc9-4a27-9b70-108138eb259a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9746a481-bbc9-4a27-9b70-108138eb259a', 'volume_size': 1} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1936251911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9746a481-bbc9-4a27-9b70-108138eb259a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36d9a396a58460abb341d0f1cf76292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:28Z,use_quota=True,user_id='8abf05d1187c4cd7b81a3be5b9aeeea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Creating volume 9746a481-bbc9-4a27-9b70-108138eb259a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:32:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:32:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:27 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a 1073741824 Jul 17 05:32:27 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:28 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a 1073741824" returned: 0 in 0.788s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:28 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a Jul 17 05:32:28 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:29 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a" returned: 0 in 0.546s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:32:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f1c57-7c92-45e6-81b3-f3f5b05e5224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9746a481-bbc9-4a27-9b70-108138eb259a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e82885-df35-42a5-b498-a79d53ea7168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Volume volume-9746a481-bbc9-4a27-9b70-108138eb259a (9746a481-bbc9-4a27-9b70-108138eb259a): created successfully Jul 17 05:32:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e82885-df35-42a5-b498-a79d53ea7168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Flow 'volume_create_manager' (9cfc6af6-2771-4144-a074-9538937cb087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-50d0a666-0ea2-4556-9840-eaf8927f3103 tempest-AttachVolumeTestJSON-412024937 None] Created volume successfully. Jul 17 05:32:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-1e5dadc1-322d-4ff9-9666-fb941339ba1e req-cc308a13-985b-434d-b95a-5c73d80f0d80 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-1e5dadc1-322d-4ff9-9666-fb941339ba1e req-cc308a13-985b-434d-b95a-5c73d80f0d80 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-1e5dadc1-322d-4ff9-9666-fb941339ba1e req-cc308a13-985b-434d-b95a-5c73d80f0d80 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-1e5dadc1-322d-4ff9-9666-fb941339ba1e req-cc308a13-985b-434d-b95a-5c73d80f0d80 tempest-AttachVolumeTestJSON-412024937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-9746a481-bbc9-4a27-9b70-108138eb259a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e68c335c-7db2-49a7-a212-0a16c4b8c324', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:32:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-1e5dadc1-322d-4ff9-9666-fb941339ba1e req-cc308a13-985b-434d-b95a-5c73d80f0d80 tempest-AttachVolumeTestJSON-412024937 None] attachment_update completed successfully. Jul 17 05:32:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-bb581aa9-4561-4fce-a0f6-0714e10ec703 req-57a566e7-3dd2-46f5-b37f-865c93658bb7 tempest-AttachVolumeTestJSON-412024937 None] Terminate volume connection completed successfully. Jul 17 05:32:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bb581aa9-4561-4fce-a0f6-0714e10ec703 req-57a566e7-3dd2-46f5-b37f-865c93658bb7 tempest-AttachVolumeTestJSON-412024937 None] Deleting attachment 4b2fcc43-bc78-431c-a6e6-a70be4a5ee67. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:32:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-628bbd79-44e7-4cbd-a3bb-869998d52850 req-4e110e02-1d1c-488c-80aa-e766eebcb87d tempest-AttachVolumeTestJSON-412024937 None] Terminate volume connection completed successfully. Jul 17 05:32:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-628bbd79-44e7-4cbd-a3bb-869998d52850 req-4e110e02-1d1c-488c-80aa-e766eebcb87d tempest-AttachVolumeTestJSON-412024937 None] Deleting attachment e68c335c-7db2-49a7-a212-0a16c4b8c324. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:32:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "cinder-9746a481-bbc9-4a27-9b70-108138eb259a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:32:44 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=21,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:32:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-9746a481-bbc9-4a27-9b70-108138eb259a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:32:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "cinder-quobyte-9746a481-bbc9-4a27-9b70-108138eb259a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:32:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-quobyte-9746a481-bbc9-4a27-9b70-108138eb259a" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd832c72-0778-46c7-90f0-5d333b84dfda]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:45 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a Jul 17 05:32:45 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:45 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:45 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a Jul 17 05:32:45 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:45 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9746a481-bbc9-4a27-9b70-108138eb259a" returned: 0 in 0.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-quobyte-9746a481-bbc9-4a27-9b70-108138eb259a" released by "delete_volume" :: held 0.745s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Created reservations ['7fc62e26-3f32-4f0b-be44-b606a752b3cc', 'bcbcbe12-6c6a-46f8-84af-2daf1a29d51d', '962217bd-e148-4e2e-9bb2-09c91518f1bd', '2946473e-9f58-4533-842d-066b620b9ff3'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:46 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:32:46 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "cinder-ab8a1221-2dd8-425c-997d-05a1ccec56ff-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-ab8a1221-2dd8-425c-997d-05a1ccec56ff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "cinder-quobyte-ab8a1221-2dd8-425c-997d-05a1ccec56ff" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-quobyte-ab8a1221-2dd8-425c-997d-05a1ccec56ff" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fdb6ba-07a0-44be-8e62-868f13cc5d1e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:46 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.480s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:32:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Deleted volume successfully. Jul 17 05:32:46 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff Jul 17 05:32:46 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8c5b2f9d-3f77-4a06-ad45-9031c27772a8 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-9746a481-bbc9-4a27-9b70-108138eb259a-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:46 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:46 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff Jul 17 05:32:46 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:47 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ab8a1221-2dd8-425c-997d-05a1ccec56ff" returned: 0 in 0.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-quobyte-ab8a1221-2dd8-425c-997d-05a1ccec56ff" released by "delete_volume" :: held 0.800s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Created reservations ['f1a3d2f8-11a9-49da-89f8-6202c3d19bed', 'c561479c-e958-418b-b546-cf31f4801543', '35aef27c-6791-4263-a419-d654be254b02', '1c9be74f-6b94-406a-ae86-1a60ff3e6c7a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:47 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:32:47 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "cinder-2144338e-c43f-46f0-ad2f-5056d91a2520-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-2144338e-c43f-46f0-ad2f-5056d91a2520-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:32:47 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "cinder-quobyte-2144338e-c43f-46f0-ad2f-5056d91a2520" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.331s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:32:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Deleted volume successfully. Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-quobyte-2144338e-c43f-46f0-ad2f-5056d91a2520" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4e47fd6a-6154-4de5-b1e4-75cb0925a283 tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-ab8a1221-2dd8-425c-997d-05a1ccec56ff-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0323a3-8643-4bde-95f4-7cc2dd1b4207]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:47 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 Jul 17 05:32:47 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:47 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:48 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520 Jul 17 05:32:48 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:48 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2144338e-c43f-46f0-ad2f-5056d91a2520" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-quobyte-2144338e-c43f-46f0-ad2f-5056d91a2520" released by "delete_volume" :: held 0.684s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Created reservations ['492900ae-4f96-4086-9006-fed0c8e697a2', '337ff856-ff79-4ffa-9172-ef3e949baa36', 'e738fc79-1366-4a03-a028-c612dc15ce80', '43d70eff-c82f-467a-b561-b8dae8f01cc8'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:48 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:32:48 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:48 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:32:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Deleted volume successfully. Jul 17 05:32:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba80a782-d194-4d9a-a659-6078c9a1e90a tempest-AttachVolumeTestJSON-412024937 None] Lock "cinder-2144338e-c43f-46f0-ad2f-5056d91a2520-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Flow 'volume_create_manager' (e5485c76-9082-4c67-b253-751eedacc71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5539c572-270e-494e-b761-34a6a0a6b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5539c572-270e-494e-b761-34a6a0a6b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-302533027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2434222f-4e6f-4dd0-a1bf-2a2ed1be5100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06472ac4a3454923a0ffb0b6d73351bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:55Z,use_quota=True,user_id='66c9168578d5497c91a1bcc04b05800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d71a8a6-2342-4bd7-99cb-ad368a4c409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d71a8a6-2342-4bd7-99cb-ad368a4c409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d16fbc-bffe-439a-af83-21fa49dad0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d16fbc-bffe-439a-af83-21fa49dad0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2434222f-4e6f-4dd0-a1bf-2a2ed1be5100', 'volume_name': 'volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7ec6eb-c16f-4ec7-9aa7-9c682966371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7ec6eb-c16f-4ec7-9aa7-9c682966371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6dc1c4-2dd0-4002-92fb-54caa27a8876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Volume 2434222f-4e6f-4dd0-a1bf-2a2ed1be5100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100', 'volume_size': 1} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-302533027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2434222f-4e6f-4dd0-a1bf-2a2ed1be5100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06472ac4a3454923a0ffb0b6d73351bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:55Z,use_quota=True,user_id='66c9168578d5497c91a1bcc04b05800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Creating volume 2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:32:55 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:32:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:55 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 1073741824 Jul 17 05:32:55 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:56 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:32:56 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:56 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 1073741824" returned: 0 in 0.943s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:56 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 Jul 17 05:32:56 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:56 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:32:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:32:57 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100" returned: 0 in 0.460s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:32:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6dc1c4-2dd0-4002-92fb-54caa27a8876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ba65af-17c5-469b-8d34-93dee8a15f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Volume volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 (2434222f-4e6f-4dd0-a1bf-2a2ed1be5100): created successfully Jul 17 05:32:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ba65af-17c5-469b-8d34-93dee8a15f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Flow 'volume_create_manager' (e5485c76-9082-4c67-b253-751eedacc71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-029718ff-2131-4b77-acc9-b9ff3cc81259 tempest-AttachVolumeNegativeTest-60718988 None] Created volume successfully. Jul 17 05:32:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-244ba934-9f5c-4fc8-8688-cd878286ae20 req-ae978563-21b7-4534-9d30-abb8efb63906 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-244ba934-9f5c-4fc8-8688-cd878286ae20 req-ae978563-21b7-4534-9d30-abb8efb63906 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-244ba934-9f5c-4fc8-8688-cd878286ae20 req-ae978563-21b7-4534-9d30-abb8efb63906 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-244ba934-9f5c-4fc8-8688-cd878286ae20 req-ae978563-21b7-4534-9d30-abb8efb63906 tempest-AttachVolumeNegativeTest-60718988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8663a4a3-5e51-4d89-9ba6-010812d7737f', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:32:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-244ba934-9f5c-4fc8-8688-cd878286ae20 req-ae978563-21b7-4534-9d30-abb8efb63906 tempest-AttachVolumeNegativeTest-60718988 None] attachment_update completed successfully. Jul 17 05:32:58 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:32:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Flow 'volume_create_manager' (be46584b-902f-42d0-87c7-363b5b565a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f0fc76-5901-4e9d-90ed-3ccf2bf50f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f0fc76-5901-4e9d-90ed-3ccf2bf50f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-59254490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79aaf717-d89f-4e88-9fe0-bae913ed3869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a6da8ffb75424ea2541e9c181a7cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:59Z,use_quota=True,user_id='9f9581531d9840c1a7298c89aab17bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c8919a-0c4f-4351-8abf-61876833a6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c8919a-0c4f-4351-8abf-61876833a6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fa433e-4e96-48e3-b2cd-d031a8b2cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fa433e-4e96-48e3-b2cd-d031a8b2cc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79aaf717-d89f-4e88-9fe0-bae913ed3869', 'volume_name': 'volume-79aaf717-d89f-4e88-9fe0-bae913ed3869', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf17399e-6d62-4bd9-a777-2f7df0738f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf17399e-6d62-4bd9-a777-2f7df0738f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef90456-91a6-494c-bb59-caa895dc5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Volume 79aaf717-d89f-4e88-9fe0-bae913ed3869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79aaf717-d89f-4e88-9fe0-bae913ed3869', 'volume_size': 1} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-59254490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79aaf717-d89f-4e88-9fe0-bae913ed3869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a6da8ffb75424ea2541e9c181a7cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:59Z,use_quota=True,user_id='9f9581531d9840c1a7298c89aab17bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Creating volume 79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:32:59 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:59 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 1073741824 Jul 17 05:32:59 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (2dd3e6ce-09e1-4a2a-9c65-ee7a43499ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b76ba61-65fa-4fdb-aabd-d09da4e3feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b76ba61-65fa-4fdb-aabd-d09da4e3feb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710566301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2534b70-65d1-4daa-bb77-108a315ebeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:59Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ba6a3c-6bed-4df8-9f9c-07821379bfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ba6a3c-6bed-4df8-9f9c-07821379bfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1e6fbd-1f51-42a7-be38-a7d90b61c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1e6fbd-1f51-42a7-be38-a7d90b61c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2534b70-65d1-4daa-bb77-108a315ebeeb', 'volume_name': 'volume-e2534b70-65d1-4daa-bb77-108a315ebeeb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb426e12-1813-4b41-b222-8eabc7bbb6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb426e12-1813-4b41-b222-8eabc7bbb6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed29a02e-9a6b-48e4-ad84-e09018bbc766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:32:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Volume e2534b70-65d1-4daa-bb77-108a315ebeeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2534b70-65d1-4daa-bb77-108a315ebeeb', 'volume_size': 1} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:32:59 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 1073741824" returned: 0 in 0.641s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:32:59 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 Jul 17 05:32:59 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:32:59 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jul 17 05:32:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710566301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2534b70-65d1-4daa-bb77-108a315ebeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:32:59Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Creating volume e2534b70-65d1-4daa-bb77-108a315ebeeb {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:00 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef90456-91a6-494c-bb59-caa895dc5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79aaf717-d89f-4e88-9fe0-bae913ed3869', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:00 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb 1073741824 Jul 17 05:33:00 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219d93d0-7f70-4200-b817-f53c8874f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Volume volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 (79aaf717-d89f-4e88-9fe0-bae913ed3869): created successfully Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219d93d0-7f70-4200-b817-f53c8874f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Flow 'volume_create_manager' (be46584b-902f-42d0-87c7-363b5b565a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3b8fcae7-f399-47a2-a5b6-8100eb7d29a1 req-a090603f-ab24-4f63-97c3-ee07ee3ba3b8 tempest-VolumesSnapshotsTestJSON-548710753 None] Created volume successfully. Jul 17 05:33:00 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb 1073741824" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:00 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb Jul 17 05:33:00 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:00 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed29a02e-9a6b-48e4-ad84-e09018bbc766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2534b70-65d1-4daa-bb77-108a315ebeeb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcf805c-c8c2-4181-b2ba-8a22a49c4504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Volume volume-e2534b70-65d1-4daa-bb77-108a315ebeeb (e2534b70-65d1-4daa-bb77-108a315ebeeb): created successfully Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcf805c-c8c2-4181-b2ba-8a22a49c4504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (2dd3e6ce-09e1-4a2a-9c65-ee7a43499ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-354c8bb7-8caf-4b46-a195-6c1f845a3b37 tempest-VolumesActionsTest-420372872 None] Created volume successfully. Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Creating offline snapshot d33c409e-2a37-4c32-bbc7-e1253adad3f8 of volume 79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a750ff-a43e-48ca-9a55-31d2c5ddb785]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f47e96af-377d-4b91-9e52-8b0abc8a6b6e tempest-VolumesActionsTest-420372872 None] Acquiring lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb" by "attach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f47e96af-377d-4b91-9e52-8b0abc8a6b6e tempest-VolumesActionsTest-420372872 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb" acquired by "attach_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:01 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 Jul 17 05:33:01 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f47e96af-377d-4b91-9e52-8b0abc8a6b6e tempest-VolumesActionsTest-420372872 None] Attaching volume e2534b70-65d1-4daa-bb77-108a315ebeeb to instance 5904820a-a258-4db6-b3bf-bed4e5220c7f at mountpoint /dev/vdb on host None. Jul 17 05:33:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f47e96af-377d-4b91-9e52-8b0abc8a6b6e tempest-VolumesActionsTest-420372872 None] Attach volume completed successfully. Jul 17 05:33:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f47e96af-377d-4b91-9e52-8b0abc8a6b6e tempest-VolumesActionsTest-420372872 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb" released by "attach_volume" :: held 0.154s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:02 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869" returned: 0 in 0.549s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:02 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 1G Jul 17 05:33:02 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:02 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 1G" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:02 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 Jul 17 05:33:02 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ceca6742-d9a5-4667-a529-2a7eb3a2386c tempest-VolumesActionsTest-234457779 None] Terminate volume connection completed successfully. Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ceca6742-d9a5-4667-a529-2a7eb3a2386c tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ceca6742-d9a5-4667-a529-2a7eb3a2386c tempest-VolumesActionsTest-234457779 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ceca6742-d9a5-4667-a529-2a7eb3a2386c tempest-VolumesActionsTest-234457779 None] Detaching volume e2534b70-65d1-4daa-bb77-108a315ebeeb from instance 5904820a-a258-4db6-b3bf-bed4e5220c7f. Jul 17 05:33:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ceca6742-d9a5-4667-a529-2a7eb3a2386c tempest-VolumesActionsTest-234457779 None] Detach volume completed successfully. Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ceca6742-d9a5-4667-a529-2a7eb3a2386c tempest-VolumesActionsTest-234457779 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:02 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:02 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 is being set with open permissions: ugo+rw Jul 17 05:33:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:03 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 Jul 17 05:33:03 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a86cae4-13af-4c6d-bea6-65192b3cd4d4 tempest-VolumesActionsTest-420372872 None] Acquiring lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a86cae4-13af-4c6d-bea6-65192b3cd4d4 tempest-VolumesActionsTest-420372872 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3a86cae4-13af-4c6d-bea6-65192b3cd4d4 tempest-VolumesActionsTest-420372872 None] Volume detach called, but volume not attached. Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a86cae4-13af-4c6d-bea6-65192b3cd4d4 tempest-VolumesActionsTest-420372872 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:03 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:03 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.info Jul 17 05:33:03 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Acquiring lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Acquiring lock "cinder-quobyte-e2534b70-65d1-4daa-bb77-108a315ebeeb" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Lock "cinder-quobyte-e2534b70-65d1-4daa-bb77-108a315ebeeb" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2901f691-cf2a-4e46-b8ae-640c0bbf7b5f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:03 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.info" returned: 0 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:03 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.info is being set with open permissions: ugo+rw Jul 17 05:33:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:03 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.info Jul 17 05:33:03 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:03 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb Jul 17 05:33:03 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:04 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.info" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:04 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb" returned: 0 in 0.579s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3ec9119f-0025-4947-a1a0-eeac71ce14a1 req-7bc1ca8f-7877-41e0-bef3-726e60a385a2 tempest-VolumesSnapshotsTestJSON-548710753 None] Create snapshot completed successfully Jul 17 05:33:04 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb Jul 17 05:33:04 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:04 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e2534b70-65d1-4daa-bb77-108a315ebeeb" returned: 0 in 0.325s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Lock "cinder-quobyte-e2534b70-65d1-4daa-bb77-108a315ebeeb" released by "delete_volume" :: held 0.974s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Created reservations ['806789b0-c071-40c2-84ba-131cd6416350', 'fe9693b9-dac4-4411-9480-5f1ed50110d6', '0737d9e6-b48e-4a1e-9f11-758461b5d67f', 'f7606199-05b4-406f-8b3d-a5852426952d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:04 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:04 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "cinder-d33c409e-2a37-4c32-bbc7-e1253adad3f8-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-d33c409e-2a37-4c32-bbc7-e1253adad3f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:05 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "cinder-quobyte-79aaf717-d89f-4e88-9fe0-bae913ed3869" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-quobyte-79aaf717-d89f-4e88-9fe0-bae913ed3869" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "cinder-quobyte-d33c409e-2a37-4c32-bbc7-e1253adad3f8" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Deleted volume successfully. Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-quobyte-d33c409e-2a37-4c32-bbc7-e1253adad3f8" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Deleting offline snapshot d33c409e-2a37-4c32-bbc7-e1253adad3f8 of volume 79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] snapshot_file for this snap is: volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5374bbf1-f735-4585-80ac-4de13826301b tempest-VolumesActionsTest-420372872 None] Lock "cinder-e2534b70-65d1-4daa-bb77-108a315ebeeb-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[393807cf-c611-4481-ab72-547ee27c9b6b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:05 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 Jul 17 05:33:05 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:05 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8" returned: 0 in 0.589s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79aaf717-d89f-4e88-9fe0-bae913ed3869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a4b0f-eb43-4c0f-bbcc-cbd05195adff]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:06 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 Jul 17 05:33:06 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:06 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869" returned: 0 in 0.564s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:06 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 Jul 17 05:33:06 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:07 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8" returned: 0 in 0.518s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:07 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8 Jul 17 05:33:07 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:07 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869.d33c409e-2a37-4c32-bbc7-e1253adad3f8" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-quobyte-d33c409e-2a37-4c32-bbc7-e1253adad3f8" released by "_delete_snapshot" :: held 2.153s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-quobyte-79aaf717-d89f-4e88-9fe0-bae913ed3869" released by "delete_snapshot" :: held 2.233s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:07 devstack cinder-volume[87750]: DEBUG cinder.quota [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Created reservations ['a975afda-1c60-40bf-9d4e-c2d771a025b6', '061fc9b2-ace3-4772-a7b4-3d6f652250f8', '36b0e2f8-0214-45f4-b001-ffcc57d7f960', '05eb393f-986c-45c8-88f3-0efae6423aa5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Delete snapshot completed successfully. Jul 17 05:33:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-2745c2f3-373d-4ccf-a5de-412b619f37a9 req-04b5637c-21b0-4648-9414-87c4c5751a86 tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-d33c409e-2a37-4c32-bbc7-e1253adad3f8-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "cinder-79aaf717-d89f-4e88-9fe0-bae913ed3869-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-79aaf717-d89f-4e88-9fe0-bae913ed3869-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "cinder-quobyte-79aaf717-d89f-4e88-9fe0-bae913ed3869" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-quobyte-79aaf717-d89f-4e88-9fe0-bae913ed3869" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d139683-40ce-4905-a1f5-acadecbf69ca]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:08 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 Jul 17 05:33:08 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (6d13f8a4-13c5-4692-b563-640625a4440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca31698-2d76-48dd-a6c5-16871cd8880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca31698-2d76-48dd-a6c5-16871cd8880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-635932756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ce5be8-2978-4879-a413-863ba4de8440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:09Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b879fb-84ce-4a10-b73a-537a9f44963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b879fb-84ce-4a10-b73a-537a9f44963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aef985-7b86-4962-8edb-84096277fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aef985-7b86-4962-8edb-84096277fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ce5be8-2978-4879-a413-863ba4de8440', 'volume_name': 'volume-95ce5be8-2978-4879-a413-863ba4de8440', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e0c8af-6cac-43a0-ada7-b0b6a2b89a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e0c8af-6cac-43a0-ada7-b0b6a2b89a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae97de96-8bc9-408a-b21c-2d33c82ee8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Volume 95ce5be8-2978-4879-a413-863ba4de8440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ce5be8-2978-4879-a413-863ba4de8440', 'volume_size': 1} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-635932756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ce5be8-2978-4879-a413-863ba4de8440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:09Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Creating volume 95ce5be8-2978-4879-a413-863ba4de8440 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:09 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:09 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 1073741824 Jul 17 05:33:09 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:09 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869" returned: 0 in 0.789s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:09 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869 Jul 17 05:33:09 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:10 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79aaf717-d89f-4e88-9fe0-bae913ed3869" returned: 0 in 0.559s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-quobyte-79aaf717-d89f-4e88-9fe0-bae913ed3869" released by "delete_volume" :: held 1.435s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.quota [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Created reservations ['5c25ba52-76ee-4559-b35b-89d04eba23a4', 'e2c45fe5-c981-46c6-97d4-a708fe78c304', 'f21c8a03-bf27-4756-a878-401c7e711ca7', '71c7ca79-c1dc-416f-a078-f78916d8f554'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:10 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 1073741824" returned: 0 in 1.020s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:10 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 Jul 17 05:33:10 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:10 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:10 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:10 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440" returned: 0 in 0.419s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae97de96-8bc9-408a-b21c-2d33c82ee8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ce5be8-2978-4879-a413-863ba4de8440', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de35037e-3312-4b53-94b2-b58ac12355bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:10 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Volume volume-95ce5be8-2978-4879-a413-863ba4de8440 (95ce5be8-2978-4879-a413-863ba4de8440): created successfully Jul 17 05:33:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de35037e-3312-4b53-94b2-b58ac12355bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:10 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (6d13f8a4-13c5-4692-b563-640625a4440d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.512s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:11 devstack cinder-volume[87750]: DEBUG cinder.manager [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Deleted volume successfully. Jul 17 05:33:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9e9681c2-4e02-463b-8add-c84c66cf5e2f tempest-VolumesActionsTest-420372872 None] Created volume successfully. Jul 17 05:33:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5c83f0e3-d0c3-460c-b410-2093c61ba71d req-8d6c2e9a-0de4-4301-a38a-eb13aeee92cc tempest-VolumesSnapshotsTestJSON-548710753 None] Lock "cinder-79aaf717-d89f-4e88-9fe0-bae913ed3869-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-95ce5be8-2978-4879-a413-863ba4de8440-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-95ce5be8-2978-4879-a413-863ba4de8440-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-quobyte-95ce5be8-2978-4879-a413-863ba4de8440" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-95ce5be8-2978-4879-a413-863ba4de8440" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5993acd2-6c51-4916-a455-34b4b73c6c81]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:12 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 Jul 17 05:33:12 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:12 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440" returned: 0 in 0.789s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:12 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440 Jul 17 05:33:12 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:13 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-95ce5be8-2978-4879-a413-863ba4de8440" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-95ce5be8-2978-4879-a413-863ba4de8440" released by "delete_volume" :: held 1.232s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=77,cinder:SELECT=67,cinder:DELETE=7,cinder:INSERT=17 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Created reservations ['582bdf79-b08a-4429-a067-e90439a75bf3', 'f4dac5a0-22aa-436f-9aa0-4a2607772eb7', 'fb5f40a1-da0d-49d0-a9bd-1a3bbc54307d', '618dbe75-82f6-4007-b573-c16833ead0dc'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:13 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:13 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:14 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.682s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:14 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Deleted volume successfully. Jul 17 05:33:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22e0a9ba-b9c5-4d3b-a5cd-533f1908d0b0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-95ce5be8-2978-4879-a413-863ba4de8440-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-48f604f9-1546-49a0-bbab-55f7846bd2b6 req-c6aab236-1556-4b39-83c5-b434d4d4db30 tempest-TestMinimumBasicScenario-661173975 None] Terminate volume connection completed successfully. Jul 17 05:33:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-48f604f9-1546-49a0-bbab-55f7846bd2b6 req-c6aab236-1556-4b39-83c5-b434d4d4db30 tempest-TestMinimumBasicScenario-661173975 None] Deleting attachment 4ca8a57b-5dc2-4e16-9926-9341715ebb30. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (9e7e6027-7e3c-4bc6-892f-2971e6ec2a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7e0763-c417-4a38-87e2-5cce36781f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7e0763-c417-4a38-87e2-5cce36781f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679552596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb785231-8017-4e68-b5dd-0ded1a9ffb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:15Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2564e65c-001f-45a0-aeef-f0f6a1f9d306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2564e65c-001f-45a0-aeef-f0f6a1f9d306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da5b727-1ca1-4b6d-9fd5-419cf5a8089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da5b727-1ca1-4b6d-9fd5-419cf5a8089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb785231-8017-4e68-b5dd-0ded1a9ffb37', 'volume_name': 'volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23202db-458e-46aa-9274-2fa0c865c2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23202db-458e-46aa-9274-2fa0c865c2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a03787f-9e8f-4835-accf-8ff65559a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Volume fb785231-8017-4e68-b5dd-0ded1a9ffb37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37', 'volume_size': 1} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679552596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb785231-8017-4e68-b5dd-0ded1a9ffb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:15Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Creating volume fb785231-8017-4e68-b5dd-0ded1a9ffb37 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:15 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:15 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 1073741824 Jul 17 05:33:15 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Acquiring lock "cinder-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Lock "cinder-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Acquiring lock "cinder-quobyte-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Lock "cinder-quobyte-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a70596c-d721-46b3-b041-5870ca1f5592]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:16 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 Jul 17 05:33:16 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:16 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 1073741824" returned: 0 in 0.811s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:16 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 Jul 17 05:33:16 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:16 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2" returned: 0 in 0.700s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:16 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2 Jul 17 05:33:16 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:16 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37" returned: 0 in 0.497s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a03787f-9e8f-4835-accf-8ff65559a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca1615b-68f2-4946-a1a2-f97cbd88f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Volume volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 (fb785231-8017-4e68-b5dd-0ded1a9ffb37): created successfully Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca1615b-68f2-4946-a1a2-f97cbd88f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (9e7e6027-7e3c-4bc6-892f-2971e6ec2a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4c04e532-0562-4343-8d76-5d98676d835e tempest-VolumesActionsTest-420372872 None] Created volume successfully. Jul 17 05:33:17 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2" returned: 0 in 0.568s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Lock "cinder-quobyte-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2" released by "delete_volume" :: held 1.354s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Created reservations ['1b0d65f0-f78b-4e6c-ae37-b6a5a8c16a3b', 'fd35420e-26f8-467d-a5e0-3ed5d158349e', '1422b10d-90f3-421c-b2b6-fd0dfa81c00b', '9c803c35-7f6a-4074-9d04-7e16efdf530b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:17 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:17 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-fb785231-8017-4e68-b5dd-0ded1a9ffb37-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Lock "cinder-fb785231-8017-4e68-b5dd-0ded1a9ffb37-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-quobyte-fb785231-8017-4e68-b5dd-0ded1a9ffb37" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-fb785231-8017-4e68-b5dd-0ded1a9ffb37" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fdce0a-7dac-4c6d-af09-3baea6a312aa]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:18 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 Jul 17 05:33:18 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:18 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.581s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Deleted volume successfully. Jul 17 05:33:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4100f257-38dd-4e88-82f0-4f1d94864d83 tempest-TestMinimumBasicScenario-661173975 None] Lock "cinder-8d67543d-ed33-4bde-a8f9-bcb0ac6294f2-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:18 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37" returned: 0 in 0.559s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:18 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37 Jul 17 05:33:18 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:19 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-fb785231-8017-4e68-b5dd-0ded1a9ffb37" returned: 0 in 0.633s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-fb785231-8017-4e68-b5dd-0ded1a9ffb37" released by "delete_volume" :: held 1.364s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Created reservations ['f29a23d4-a065-44f0-812b-60a0f2f520fb', '2f8d9676-4672-4b73-96ff-0b6979759598', 'c99decc6-c937-4de9-a286-32b7731d981c', '2b5a4137-0e02-4ad4-85a2-3f383a374cd2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Flow 'volume_create_manager' (985e5289-573c-41f8-90ac-5ca43b25ded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff271fa-4c1c-4a2c-a41b-6deba20cbc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff271fa-4c1c-4a2c-a41b-6deba20cbc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-903248255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a714ccc-428d-42fb-97f6-1bd75a08e59f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75517a56646a405a83520a885c1d7c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:19Z,use_quota=True,user_id='b13e6d70d9154a7990d80d111d75455f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaea7d-6992-4f3f-a95f-7f6de835df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaea7d-6992-4f3f-a95f-7f6de835df47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9102eb8-b45c-455e-af5e-d917b667d3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9102eb8-b45c-455e-af5e-d917b667d3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a714ccc-428d-42fb-97f6-1bd75a08e59f', 'volume_name': 'volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfce0c2-2253-460b-adb8-5674172b3b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfce0c2-2253-460b-adb8-5674172b3b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1ef860-58a7-4728-8f03-39547c469dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:19 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Volume 0a714ccc-428d-42fb-97f6-1bd75a08e59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f', 'volume_size': 1} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-903248255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a714ccc-428d-42fb-97f6-1bd75a08e59f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75517a56646a405a83520a885c1d7c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:19Z,use_quota=True,user_id='b13e6d70d9154a7990d80d111d75455f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Creating volume 0a714ccc-428d-42fb-97f6-1bd75a08e59f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:19 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f 1073741824 Jul 17 05:33:19 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:19 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:19 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:20 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:20 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Deleted volume successfully. Jul 17 05:33:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e35c3d6a-e501-4302-b751-cc60d8b1e665 tempest-VolumesActionsTest-234457779 None] Lock "cinder-fb785231-8017-4e68-b5dd-0ded1a9ffb37-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:20 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f 1073741824" returned: 0 in 1.113s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:20 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f Jul 17 05:33:20 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:21 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1ef860-58a7-4728-8f03-39547c469dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4049cc53-49f7-4c04-9850-8e69b6804b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (9061e96e-3f14-4514-8515-65a1dc7094f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d1e56f-b85e-41a8-aede-4f39faccf46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Volume volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f (0a714ccc-428d-42fb-97f6-1bd75a08e59f): created successfully Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4049cc53-49f7-4c04-9850-8e69b6804b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Flow 'volume_create_manager' (985e5289-573c-41f8-90ac-5ca43b25ded0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d1e56f-b85e-41a8-aede-4f39faccf46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1996231810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3666172-d90c-496f-979b-fed34ef08ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:21Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e483f028-8b4a-459c-a2f8-0f87389c07ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e483f028-8b4a-459c-a2f8-0f87389c07ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f09c7dc-57dc-4ee4-80fa-5fda29c4f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f09c7dc-57dc-4ee4-80fa-5fda29c4f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3666172-d90c-496f-979b-fed34ef08ff3', 'volume_name': 'volume-d3666172-d90c-496f-979b-fed34ef08ff3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b840990c-bfbe-4c14-9755-33c47037533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b840990c-bfbe-4c14-9755-33c47037533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fe11bf-7b3b-4f4f-a071-038b1d2b670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Volume d3666172-d90c-496f-979b-fed34ef08ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3666172-d90c-496f-979b-fed34ef08ff3', 'volume_size': 1} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1996231810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3666172-d90c-496f-979b-fed34ef08ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:21Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Creating volume d3666172-d90c-496f-979b-fed34ef08ff3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:21 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-ee3ab7f9-b8fb-48bc-b4af-2071a2d84cbc req-58c966e0-eb4a-4a18-8dcd-6fcf9d37a080 tempest-VolumesGetTestJSON-1603190596 None] Created volume successfully. Jul 17 05:33:21 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 1073741824 Jul 17 05:33:21 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:22 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 1073741824" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:22 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 Jul 17 05:33:22 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Acquiring lock "cinder-0a714ccc-428d-42fb-97f6-1bd75a08e59f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Lock "cinder-0a714ccc-428d-42fb-97f6-1bd75a08e59f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Acquiring lock "cinder-quobyte-0a714ccc-428d-42fb-97f6-1bd75a08e59f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Lock "cinder-quobyte-0a714ccc-428d-42fb-97f6-1bd75a08e59f" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb1332-687d-4c34-ac29-4722c01fcd72]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:22 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fe11bf-7b3b-4f4f-a071-038b1d2b670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3666172-d90c-496f-979b-fed34ef08ff3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c967e010-f609-4411-afcf-104656d4f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Volume volume-d3666172-d90c-496f-979b-fed34ef08ff3 (d3666172-d90c-496f-979b-fed34ef08ff3): created successfully Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c967e010-f609-4411-afcf-104656d4f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (9061e96e-3f14-4514-8515-65a1dc7094f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:22 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f Jul 17 05:33:22 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2fbc50ed-2a07-4498-bc12-0ccbc7581d5f tempest-VolumesActionsTest-420372872 None] Created volume successfully. Jul 17 05:33:22 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f" returned: 0 in 0.408s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:22 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f Jul 17 05:33:22 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:23 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0a714ccc-428d-42fb-97f6-1bd75a08e59f" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Lock "cinder-quobyte-0a714ccc-428d-42fb-97f6-1bd75a08e59f" released by "delete_volume" :: held 0.752s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.quota [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Created reservations ['175883a0-06da-4bd3-9c7f-4e826bb3ceea', '11624211-03d8-470d-a791-3cb886bd3c5e', '2cc5c4bf-909a-4525-bd11-feeb5f2c8f36', '357f126c-8ec1-4c06-b1f4-eae504d1c012'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:23 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:23 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:23 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.manager [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Deleted volume successfully. Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-d3666172-d90c-496f-979b-fed34ef08ff3-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-3406bf46-287b-46c6-90da-06481db03bf2 req-c5627e36-91e0-4c6c-8f7b-50db6db5f59c tempest-VolumesGetTestJSON-1603190596 None] Lock "cinder-0a714ccc-428d-42fb-97f6-1bd75a08e59f-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Lock "cinder-d3666172-d90c-496f-979b-fed34ef08ff3-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-quobyte-d3666172-d90c-496f-979b-fed34ef08ff3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-d3666172-d90c-496f-979b-fed34ef08ff3" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8760be-2135-4b31-84b4-55fd42902c7e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:24 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 Jul 17 05:33:24 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:24 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3" returned: 0 in 0.499s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:24 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3 Jul 17 05:33:24 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:24 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3666172-d90c-496f-979b-fed34ef08ff3" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-d3666172-d90c-496f-979b-fed34ef08ff3" released by "delete_volume" :: held 0.847s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Created reservations ['7598e51a-cf0c-445f-a9bc-040e402e1060', 'd4fb4dd2-03d0-4d5e-b189-6a972c78cecc', '83f309c1-ff54-46ad-88af-aaea8090ec25', '7b73d0e4-a3f9-47aa-9b16-8aa21b82a5ad'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:25 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:25 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:25 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Deleted volume successfully. Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6aebaddb-be77-4ce6-a249-3b2438c27eb5 tempest-VolumesActionsTest-234457779 None] Lock "cinder-d3666172-d90c-496f-979b-fed34ef08ff3-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (91dbd38b-dcf9-4d44-8756-e9645c59e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c1206d-dc03-4d30-a931-bc1f85acf5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c1206d-dc03-4d30-a931-bc1f85acf5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394877499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8574d6-c4d0-4749-983d-bd26b7588e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:26Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19daac59-322b-4118-a9d3-898b76463922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19daac59-322b-4118-a9d3-898b76463922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efaf0f1-4796-43b8-a095-2346f6515d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efaf0f1-4796-43b8-a095-2346f6515d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8574d6-c4d0-4749-983d-bd26b7588e84', 'volume_name': 'volume-8b8574d6-c4d0-4749-983d-bd26b7588e84', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44566a57-5872-441f-85ad-1e1467929547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44566a57-5872-441f-85ad-1e1467929547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b119e3-8618-4724-88b4-728ca0931aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Volume 8b8574d6-c4d0-4749-983d-bd26b7588e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8574d6-c4d0-4749-983d-bd26b7588e84', 'volume_size': 1} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394877499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8574d6-c4d0-4749-983d-bd26b7588e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:26Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Creating volume 8b8574d6-c4d0-4749-983d-bd26b7588e84 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:25 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:25 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 1073741824 Jul 17 05:33:25 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:26 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 1073741824" returned: 0 in 0.598s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:26 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 Jul 17 05:33:26 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:26 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b119e3-8618-4724-88b4-728ca0931aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8574d6-c4d0-4749-983d-bd26b7588e84', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be931fd-5663-4c3f-80a5-e4b86effd039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:26 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Volume volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 (8b8574d6-c4d0-4749-983d-bd26b7588e84): created successfully Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be931fd-5663-4c3f-80a5-e4b86effd039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (91dbd38b-dcf9-4d44-8756-e9645c59e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-79e424ac-afc2-4ebd-8ba8-c29e59a762d8 tempest-VolumesActionsTest-420372872 None] Created volume successfully. Jul 17 05:33:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-8b8574d6-c4d0-4749-983d-bd26b7588e84-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-8b8574d6-c4d0-4749-983d-bd26b7588e84-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Acquiring lock "cinder-quobyte-8b8574d6-c4d0-4749-983d-bd26b7588e84" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-8b8574d6-c4d0-4749-983d-bd26b7588e84" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cf2d5f-1549-42b1-b524-bba8e58a44e0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:28 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 Jul 17 05:33:28 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:28 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:28 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84 Jul 17 05:33:28 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:28 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8b8574d6-c4d0-4749-983d-bd26b7588e84" returned: 0 in 0.278s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-quobyte-8b8574d6-c4d0-4749-983d-bd26b7588e84" released by "delete_volume" :: held 0.795s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Created reservations ['84de5ba0-959a-42e9-821b-ccf0dae1650c', '65714c6b-cd4c-4b90-a074-0abee50e5175', '9a7770cf-3392-42ae-92c7-8ff131fdd827', '0be540fc-5192-4e27-9a2b-d785f8d170bf'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:29 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:29 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:29 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.418s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Deleted volume successfully. Jul 17 05:33:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-41b44128-dcf1-47e0-9f4b-265ca2bafff0 tempest-VolumesActionsTest-234457779 None] Lock "cinder-8b8574d6-c4d0-4749-983d-bd26b7588e84-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:29 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (4ee5968d-5481-4d95-bf5b-03add253c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bf91fd-2196-4f98-8a7b-f1b5a6f0654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bf91fd-2196-4f98-8a7b-f1b5a6f0654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1802247920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd46fa51-aaa2-4071-b365-06c0751e5368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:30Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62361ba9-0658-47f9-8d2f-d68aa5aadcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62361ba9-0658-47f9-8d2f-d68aa5aadcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e207d4b-26e5-4313-99c0-c7108a54d3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e207d4b-26e5-4313-99c0-c7108a54d3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd46fa51-aaa2-4071-b365-06c0751e5368', 'volume_name': 'volume-dd46fa51-aaa2-4071-b365-06c0751e5368', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc642e1-5042-409a-b108-e4cade9d9838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc642e1-5042-409a-b108-e4cade9d9838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3876157e-42d9-4c6b-a13d-608818464924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Volume dd46fa51-aaa2-4071-b365-06c0751e5368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd46fa51-aaa2-4071-b365-06c0751e5368', 'volume_size': 1} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1802247920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd46fa51-aaa2-4071-b365-06c0751e5368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f49fa38a0264bf7a19d45a5b4a90031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:30Z,use_quota=True,user_id='2d23842b45c24869bb33f860df19ad29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Creating volume dd46fa51-aaa2-4071-b365-06c0751e5368 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:30 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:30 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 1073741824 Jul 17 05:33:30 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:30 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 1073741824" returned: 0 in 0.829s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:31 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 Jul 17 05:33:31 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:31 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3876157e-42d9-4c6b-a13d-608818464924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd46fa51-aaa2-4071-b365-06c0751e5368', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3c1953-b29b-4c2a-82a8-0ec1987748d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Volume volume-dd46fa51-aaa2-4071-b365-06c0751e5368 (dd46fa51-aaa2-4071-b365-06c0751e5368): created successfully Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3c1953-b29b-4c2a-82a8-0ec1987748d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Flow 'volume_create_manager' (4ee5968d-5481-4d95-bf5b-03add253c13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f3234601-f8df-4354-b6c5-901bbd40866e tempest-VolumesActionsTest-420372872 None] Created volume successfully. Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Acquiring lock "cinder-dd46fa51-aaa2-4071-b365-06c0751e5368-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Lock "cinder-dd46fa51-aaa2-4071-b365-06c0751e5368-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Acquiring lock "cinder-quobyte-dd46fa51-aaa2-4071-b365-06c0751e5368" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Lock "cinder-quobyte-dd46fa51-aaa2-4071-b365-06c0751e5368" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7de957d-d265-42e0-8b71-2f68d9c050ec]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:33 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 Jul 17 05:33:33 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:33 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368" returned: 0 in 0.500s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:33 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368 Jul 17 05:33:33 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:34 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dd46fa51-aaa2-4071-b365-06c0751e5368" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Lock "cinder-quobyte-dd46fa51-aaa2-4071-b365-06c0751e5368" released by "delete_volume" :: held 0.817s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Created reservations ['a96a3cb5-6b3d-4f54-b888-7572f7c157f1', '814085c5-66b1-44df-acdb-c7118b8ab1c1', '731f0058-74bd-404c-8ab1-39a76fe81a96', '833098e9-1016-4302-bf23-b9326c3e3543'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:34 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:34 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:34 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Deleted volume successfully. Jul 17 05:33:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a47d631-213c-4bcc-9cc7-ecb0ea54e8b7 tempest-VolumesActionsTest-420372872 None] Lock "cinder-dd46fa51-aaa2-4071-b365-06c0751e5368-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:33:44 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=113,cinder:INSERT=32,cinder:UPDATE=136,cinder:DELETE=10 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:33:44 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=69,cinder:SELECT=42,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:33:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f6803f2a-10ab-41bf-a550-a4809b07cb75 tempest-GroupsV314Test-203138436 None] Group tempest-GroupsV314Test-Group-2053995153: creating Jul 17 05:33:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f6803f2a-10ab-41bf-a550-a4809b07cb75 tempest-GroupsV314Test-203138436 None] Group tempest-GroupsV314Test-Group-2053995153: created successfully Jul 17 05:33:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f6803f2a-10ab-41bf-a550-a4809b07cb75 tempest-GroupsV314Test-203138436 None] Create group completed successfully. Jul 17 05:33:47 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Flow 'volume_create_manager' (5fb4ace8-d7aa-4998-81d6-5543e96f3c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7324528-dee5-4b32-92a4-ef00ef370820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7324528-dee5-4b32-92a4-ef00ef370820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034852164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc69337b-fe23-42a2-af82-7458838e3b5c,host='devstack@QuobyteHD#QuobyteHD',id=7d97fbaf-7526-4d79-9428-29cdaa54719c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2223f40b9b447a1ae1ea435a39f77b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:48Z,use_quota=True,user_id='418271f9db414372ab5374ed7418e25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8cfac38-a4e3-43c9-8375-27263f520040),volume_type_id=d8cfac38-a4e3-43c9-8375-27263f520040)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c79557-8e89-4e8d-9897-330a978ec86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c79557-8e89-4e8d-9897-330a978ec86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50631b-311d-4cc1-8a17-d92e7375fbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50631b-311d-4cc1-8a17-d92e7375fbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d97fbaf-7526-4d79-9428-29cdaa54719c', 'volume_name': 'volume-7d97fbaf-7526-4d79-9428-29cdaa54719c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e974b6d9-b040-4528-b110-7ac05a6d82c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e974b6d9-b040-4528-b110-7ac05a6d82c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d165ac2-cf79-4be8-ab8c-daaef10b41ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Volume 7d97fbaf-7526-4d79-9428-29cdaa54719c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d97fbaf-7526-4d79-9428-29cdaa54719c', 'volume_size': 1} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cc69337b-fe23-42a2-af82-7458838e3b5c,created_at=2026-07-17T03:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034852164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc69337b-fe23-42a2-af82-7458838e3b5c,host='devstack@QuobyteHD#QuobyteHD',id=7d97fbaf-7526-4d79-9428-29cdaa54719c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2223f40b9b447a1ae1ea435a39f77b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:48Z,use_quota=True,user_id='418271f9db414372ab5374ed7418e25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8cfac38-a4e3-43c9-8375-27263f520040),volume_type_id=d8cfac38-a4e3-43c9-8375-27263f520040)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Creating volume 7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:33:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:48 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c 1073741824 Jul 17 05:33:48 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:48 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c 1073741824" returned: 0 in 0.664s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:48 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c Jul 17 05:33:48 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:49 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d165ac2-cf79-4be8-ab8c-daaef10b41ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d97fbaf-7526-4d79-9428-29cdaa54719c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb808e5c-5e39-4064-9ad1-d4d977feb5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Volume volume-7d97fbaf-7526-4d79-9428-29cdaa54719c (7d97fbaf-7526-4d79-9428-29cdaa54719c): created successfully Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb808e5c-5e39-4064-9ad1-d4d977feb5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Flow 'volume_create_manager' (5fb4ace8-d7aa-4998-81d6-5543e96f3c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6b0dbb00-10e2-4e09-ab18-08a43ac7c4cf tempest-GroupsV314Test-203138436 None] Created volume successfully. Jul 17 05:33:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-29838bfd-d722-4280-b9f5-24bc852fb994 req-4028ba84-2e58-476f-a8cf-f02973d1ea9b tempest-AttachVolumeNegativeTest-60718988 None] Terminate volume connection completed successfully. Jul 17 05:33:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-29838bfd-d722-4280-b9f5-24bc852fb994 req-4028ba84-2e58-476f-a8cf-f02973d1ea9b tempest-AttachVolumeNegativeTest-60718988 None] Deleting attachment 8663a4a3-5e51-4d89-9ba6-010812d7737f. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:33:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:51 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Cloning volume 7d97fbaf-7526-4d79-9428-29cdaa54719c to volume 4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 Jul 17 05:33:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Creating offline snapshot 70ab9399-8998-4cc7-801d-18ea7ad28049 of volume 7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:33:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[678386f8-0d6c-466b-a045-d1cdba0a64af]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:51 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c Jul 17 05:33:51 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:52 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c" returned: 0 in 0.489s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:52 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 1G Jul 17 05:33:52 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:52 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 1G" returned: 0 in 0.663s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d97fbaf-7526-4d79-9428-29cdaa54719c -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:52 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d97fbaf-7526-4d79-9428-29cdaa54719c -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 Jul 17 05:33:52 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Flow 'volume_create_manager' (d605d291-d89b-4c75-9ea2-2d8710f66f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8890dc43-a4c6-4d98-ba15-6eec6d837aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8890dc43-a4c6-4d98-ba15-6eec6d837aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-959818305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9b8923-a53e-4cb5-ac6c-d4f979b03553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8af77612f6d4ce0b52808e1c6c0ce4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:53Z,use_quota=True,user_id='3da1cfe4c9ae456eba686377d8871410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab48bcda-90fd-4ec6-a36f-4bf15fe46e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab48bcda-90fd-4ec6-a36f-4bf15fe46e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1898274-6458-4b01-a469-67ba66960bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1898274-6458-4b01-a469-67ba66960bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9b8923-a53e-4cb5-ac6c-d4f979b03553', 'volume_name': 'volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53adc72-fc18-4e31-a1a2-4c365fe165fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53adc72-fc18-4e31-a1a2-4c365fe165fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37294445-2ed0-4023-84d4-14328a38364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:33:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Volume cd9b8923-a53e-4cb5-ac6c-d4f979b03553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553', 'volume_size': 1} Jul 17 05:33:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:53 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d97fbaf-7526-4d79-9428-29cdaa54719c -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049" returned: 0 in 0.451s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:53 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:33:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:53 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 Jul 17 05:33:53 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:53 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:53 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.info Jul 17 05:33:53 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:53 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.info" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:53 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:33:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:53 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.info Jul 17 05:33:53 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:54 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.info" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Acquiring lock "cinder-quobyte-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] snapshot: 70ab9399-8998-4cc7-801d-18ea7ad28049, volume: 4e0c8576-ea8c-4370-a8b6-a6618ac3eb85, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fbbe2c-1616-450d-adfb-cff7af320092]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:54 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 Jul 17 05:33:54 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:54 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d97fbaf-7526-4d79-9428-29cdaa54719c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4374c-5579-4e82-b268-211a50895435]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:33:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:54 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c Jul 17 05:33:54 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:55 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c" returned: 0 in 0.481s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:55 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:33:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:55 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 Jul 17 05:33:55 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:33:56 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:33:56 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:33:56 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.555s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:33:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:33:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:34:00 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" returned: 0 in 5.902s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfe8b8-b017-4966-9428-6a0d3eaaee2d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:01 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c Jul 17 05:34:01 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:01 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c" returned: 0 in 0.654s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:01 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:34:01 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Converted 1024.00 MB image at 173.48 MB/s Jul 17 05:34:01 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 05:34:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:01 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 Jul 17 05:34:01 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:01 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" released by "_copy_volume_from_snapshot" :: held 7.909s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Acquiring lock "cinder-quobyte-70ab9399-8998-4cc7-801d-18ea7ad28049" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-70ab9399-8998-4cc7-801d-18ea7ad28049" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Deleting offline snapshot 70ab9399-8998-4cc7-801d-18ea7ad28049 of volume 7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] snapshot_file for this snap is: volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a449436a-f6d3-4263-bd93-97ab8287d0df]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:02 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 Jul 17 05:34:02 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:02 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049" returned: 0 in 0.562s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d97fbaf-7526-4d79-9428-29cdaa54719c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[744ee92b-355d-48d0-8480-4220564b289f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:02 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c Jul 17 05:34:02 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:03 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:03 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 Jul 17 05:34:03 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:03 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:34:03 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:03 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049 Jul 17 05:34:03 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:04 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c.70ab9399-8998-4cc7-801d-18ea7ad28049" returned: 0 in 0.412s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-70ab9399-8998-4cc7-801d-18ea7ad28049" released by "_delete_snapshot" :: held 2.147s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.770s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.313s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-959818305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9b8923-a53e-4cb5-ac6c-d4f979b03553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8af77612f6d4ce0b52808e1c6c0ce4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:33:53Z,use_quota=True,user_id='3da1cfe4c9ae456eba686377d8871410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Creating volume cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:34:04 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:04 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 1073741824 Jul 17 05:34:04 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9f2b08c0-f682-4816-b1d6-15f97f66bb42 tempest-GroupsV314Test-203138436 None] Create group from source-group-cc69337b-fe23-42a2-af82-7458838e3b5c completed successfully. Jul 17 05:34:04 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 1073741824" returned: 0 in 0.638s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:04 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 Jul 17 05:34:04 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:05 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" returned: 0 in 0.375s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37294445-2ed0-4023-84d4-14328a38364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e927d9c9-8362-4aec-8b8c-c3f490025c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Volume volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 (cd9b8923-a53e-4cb5-ac6c-d4f979b03553): created successfully Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e927d9c9-8362-4aec-8b8c-c3f490025c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Flow 'volume_create_manager' (d605d291-d89b-4c75-9ea2-2d8710f66f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5275d854-47a5-4be1-9f82-15b0ef4ee002 tempest-SnapshotMetadataTestJSON-2096632997 None] Created volume successfully. Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Acquiring lock "cinder-quobyte-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[df743442-5ab0-4c1a-8dfb-88a7182cf572]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:05 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 Jul 17 05:34:05 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Creating offline snapshot a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 of volume cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789c66e-f0a7-4770-869d-be38edc5e254]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:06 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" returned: 0 in 0.690s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:06 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85 Jul 17 05:34:06 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 Jul 17 05:34:06 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:06 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" returned: 0 in 0.504s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:06 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:06 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 1G Jul 17 05:34:06 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:06 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-4e0c8576-ea8c-4370-a8b6-a6618ac3eb85" released by "delete_volume" :: held 1.224s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Created reservations ['26246ae7-6679-4899-8a05-65d3a44c5c6b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:07 devstack cinder-volume[87750]: WARNING cinder.quota [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-377184270 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-377184270, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:34:07 devstack cinder-volume[87750]: WARNING cinder.quota [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-377184270 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-377184270, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Created reservations ['6e271785-7586-4506-82b9-4908b05311fc', '1cb49cda-dbcc-4dbf-919b-059b2faed541', '0ce7819f-6ea8-4e5b-b754-b4d32a35080e', 'fd99b86b-b042-4b5b-abe9-1979720b9aa0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:07 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:34:07 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:08 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 1G" returned: 0 in 1.328s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:08 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.651s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:08 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:34:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-38e1e969-bee2-46e0-8c3a-e862ba267fc9 tempest-GroupsV314Test-203138436 None] Delete group completed successfully. Jul 17 05:34:08 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 Jul 17 05:34:08 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:08 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" returned: 0 in 0.576s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:08 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 is being set with open permissions: ugo+rw Jul 17 05:34:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:08 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 Jul 17 05:34:08 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:09 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" returned: 0 in 0.408s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Acquiring lock "cinder-quobyte-7d97fbaf-7526-4d79-9428-29cdaa54719c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-7d97fbaf-7526-4d79-9428-29cdaa54719c" acquired by "delete_volume" :: waited 0.054s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[779d21df-b95f-47db-ae1a-18f9bfb98b2a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:09 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.info Jul 17 05:34:09 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:09 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c Jul 17 05:34:09 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:09 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.info" returned: 0 in 0.536s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:09 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.info is being set with open permissions: ugo+rw Jul 17 05:34:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:09 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.info Jul 17 05:34:09 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:10 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c" returned: 0 in 0.578s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:10 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c Jul 17 05:34:10 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:10 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.info" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.109s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:10 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7d97fbaf-7526-4d79-9428-29cdaa54719c" returned: 0 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Lock "cinder-quobyte-7d97fbaf-7526-4d79-9428-29cdaa54719c" released by "delete_volume" :: held 1.102s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4423a51c-61a6-48ef-badb-192cdd570d01 tempest-SnapshotMetadataTestJSON-2096632997 None] Create snapshot completed successfully Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Created reservations ['4c8bfd64-324b-42c1-95a0-d5066cad4613'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Created reservations ['0e3f34c7-0d7c-4623-a7ea-26ceccbcc10c', '55408d9a-f741-49e5-98d4-7392853d117b', '7fc09876-1a18-47a1-8c8e-1fafa22dab74', '4c5bb0e5-f033-4369-9bec-787d65f00f19'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:10 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:34:10 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:11 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.448s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:34:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c99f63ca-97b2-4b0e-86c1-3364ed234ae8 tempest-GroupsV314Test-203138436 None] Delete group completed successfully. Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "cinder-a6b0ed65-22bf-4281-81fa-2a34afb3a5e0-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-a6b0ed65-22bf-4281-81fa-2a34afb3a5e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "cinder-quobyte-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-quobyte-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "cinder-quobyte-a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-quobyte-a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Deleting offline snapshot a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 of volume cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] snapshot_file for this snap is: volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:34:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f447237a-e933-4e1c-9a98-337f1eff4551]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:12 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 Jul 17 05:34:12 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:12 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" returned: 0 in 0.642s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:34:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ff05e8-9db2-4109-8d20-2f9dc61129f5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:12 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 Jul 17 05:34:12 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:13 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" returned: 0 in 0.613s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:13 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 Jul 17 05:34:13 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:13 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" returned: 0 in 0.642s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:14 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0 Jul 17 05:34:14 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:14 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553.a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" returned: 0 in 0.465s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-quobyte-a6b0ed65-22bf-4281-81fa-2a34afb3a5e0" released by "_delete_snapshot" :: held 2.605s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-quobyte-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" released by "delete_snapshot" :: held 2.662s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Created reservations ['d026ed2d-dff2-4404-bd50-2c1d2c2ebb9a', 'a038e207-3590-488b-a3ff-dd6f466f7120', 'b0784d32-408a-4e01-b9c0-a13fd7840810', '0be06733-2000-49c0-a124-24d7e881960b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Delete snapshot completed successfully. Jul 17 05:34:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c2b38d24-9c47-4044-9e67-2fc4f603009b tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-a6b0ed65-22bf-4281-81fa-2a34afb3a5e0-delete_snapshot" released by "delete_snapshot" :: held 2.992s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "cinder-cd9b8923-a53e-4cb5-ac6c-d4f979b03553-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-cd9b8923-a53e-4cb5-ac6c-d4f979b03553-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "cinder-quobyte-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-quobyte-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4d09f1-a63a-4d04-8f2c-f7693f3abde2]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:15 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 Jul 17 05:34:15 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:16 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" returned: 0 in 0.591s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:16 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553 Jul 17 05:34:16 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:16 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" returned: 0 in 0.582s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-quobyte-cd9b8923-a53e-4cb5-ac6c-d4f979b03553" released by "delete_volume" :: held 1.287s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Created reservations ['e7127eb9-da12-4f52-81fb-bf4d4fd5bc12', '333d5cf2-f596-4217-87db-879204429306', '2bf5e2a4-7966-4e6e-b466-f8a7001f659b', 'ef4dded5-6fe7-4734-b48c-0fe55cc48aad'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:16 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:34:16 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:17 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.623s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:17 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:34:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Deleted volume successfully. Jul 17 05:34:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8bf1e659-0adf-459c-8203-53cdbe2fdedb tempest-SnapshotMetadataTestJSON-2096632997 None] Lock "cinder-cd9b8923-a53e-4cb5-ac6c-d4f979b03553-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:26 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=41,cinder:UPDATE=53,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:34:27 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=37,cinder:SELECT=35,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:34:33 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:34:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Flow 'volume_create_manager' (c3773204-54b9-485d-8f81-a8a8c3f679fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4463a7a3-3072-465f-a08e-18ee31d2da01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4463a7a3-3072-465f-a08e-18ee31d2da01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1400891385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9fb075-5064-4de8-8fe4-0413a22b83bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06472ac4a3454923a0ffb0b6d73351bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:34Z,use_quota=True,user_id='66c9168578d5497c91a1bcc04b05800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabda4a9-6d7b-48eb-a96d-68bb9256b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabda4a9-6d7b-48eb-a96d-68bb9256b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e41628-e4de-4444-bb1c-6806b1d31dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e41628-e4de-4444-bb1c-6806b1d31dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9fb075-5064-4de8-8fe4-0413a22b83bf', 'volume_name': 'volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d53af2f-fd45-40bc-ba0d-57ce29b00405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d53af2f-fd45-40bc-ba0d-57ce29b00405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4601e1ca-91d6-499b-aed2-1af8e47b1201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Volume 7f9fb075-5064-4de8-8fe4-0413a22b83bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf', 'volume_size': 1} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1400891385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9fb075-5064-4de8-8fe4-0413a22b83bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06472ac4a3454923a0ffb0b6d73351bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:34Z,use_quota=True,user_id='66c9168578d5497c91a1bcc04b05800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Creating volume 7f9fb075-5064-4de8-8fe4-0413a22b83bf {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:34:34 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:34 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf 1073741824 Jul 17 05:34:34 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:34 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf 1073741824" returned: 0 in 0.833s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:35 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf Jul 17 05:34:35 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:35 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4601e1ca-91d6-499b-aed2-1af8e47b1201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914b7f53-5990-478e-a742-d379853da863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Volume volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf (7f9fb075-5064-4de8-8fe4-0413a22b83bf): created successfully Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914b7f53-5990-478e-a742-d379853da863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Flow 'volume_create_manager' (c3773204-54b9-485d-8f81-a8a8c3f679fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-17b3afe4-9377-476c-bdb6-dd11f90129d3 tempest-AttachVolumeNegativeTest-60718988 None] Created volume successfully. Jul 17 05:34:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-339c3850-9399-4c35-b5b7-2f9ea399ed58 req-eff2a6c8-20ab-4bcf-8a3b-1ecbaf75041a tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-339c3850-9399-4c35-b5b7-2f9ea399ed58 req-eff2a6c8-20ab-4bcf-8a3b-1ecbaf75041a tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-339c3850-9399-4c35-b5b7-2f9ea399ed58 req-eff2a6c8-20ab-4bcf-8a3b-1ecbaf75041a tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-339c3850-9399-4c35-b5b7-2f9ea399ed58 req-eff2a6c8-20ab-4bcf-8a3b-1ecbaf75041a tempest-AttachVolumeNegativeTest-60718988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '041bcf41-ba4c-467c-b458-7a76401cc197', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:34:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-339c3850-9399-4c35-b5b7-2f9ea399ed58 req-eff2a6c8-20ab-4bcf-8a3b-1ecbaf75041a tempest-AttachVolumeNegativeTest-60718988 None] attachment_update completed successfully. Jul 17 05:34:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-9c76dff4-64f1-41c7-9649-9ff84a35cb51 req-7dd957e1-a2ff-4e9d-83c3-bbf002daf0ca tempest-AttachVolumeNegativeTest-60718988 None] Terminate volume connection completed successfully. Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-9c76dff4-64f1-41c7-9649-9ff84a35cb51 req-7dd957e1-a2ff-4e9d-83c3-bbf002daf0ca tempest-AttachVolumeNegativeTest-60718988 None] Deleting attachment 041bcf41-ba4c-467c-b458-7a76401cc197. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Flow 'volume_create_manager' (50a205d2-f16e-4ba5-b4c7-c158b5cbd865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34242f4-258f-4484-befe-d32e41175c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34242f4-258f-4484-befe-d32e41175c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996996493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6623dce0-2c19-4b43-ba29-90e33ef5d01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff470b17bf8f474cb0d79b5e3e3f40eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:41Z,use_quota=True,user_id='92489ca6e97d4ff5989ca32e349b7046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce413815-58fe-487b-ba53-ebe5a98aff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce413815-58fe-487b-ba53-ebe5a98aff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9a411b-dbf7-4c02-9826-02bd3346ff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9a411b-dbf7-4c02-9826-02bd3346ff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6623dce0-2c19-4b43-ba29-90e33ef5d01f', 'volume_name': 'volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99441067-20cc-4448-b456-e9bf24ecd7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99441067-20cc-4448-b456-e9bf24ecd7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68d17d2-9b2f-42a5-a948-b3eca7bba8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Volume 6623dce0-2c19-4b43-ba29-90e33ef5d01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f', 'volume_size': 1} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996996493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6623dce0-2c19-4b43-ba29-90e33ef5d01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff470b17bf8f474cb0d79b5e3e3f40eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:41Z,use_quota=True,user_id='92489ca6e97d4ff5989ca32e349b7046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Creating volume 6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:34:40 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:34:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:40 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f 1073741824 Jul 17 05:34:40 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:41 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f 1073741824" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:41 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:34:41 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:41 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.331s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68d17d2-9b2f-42a5-a948-b3eca7bba8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb354f9-dc6d-4e0c-ab8d-ac1cc7b86340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Volume volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f (6623dce0-2c19-4b43-ba29-90e33ef5d01f): created successfully Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb354f9-dc6d-4e0c-ab8d-ac1cc7b86340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Flow 'volume_create_manager' (50a205d2-f16e-4ba5-b4c7-c158b5cbd865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0c73eae4-e528-4d37-b912-c4ca6ac09295 tempest-VolumesActionsTest-1147469560 None] Created volume successfully. Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Flow 'volume_create_manager' (7cafc927-e903-435f-9715-faaf684d0b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaaa30b-5b18-4a18-8da6-2a11004fc000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaaa30b-5b18-4a18-8da6-2a11004fc000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545791706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692db72d-0da2-4cfa-8992-9a0326e238e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0283d5b2de5f409bb3eaa137ca806a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:44Z,use_quota=True,user_id='6eb0610a41a849c9aeb8106288917edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4cbbd2-d876-49e1-be78-77b93b2ae073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4cbbd2-d876-49e1-be78-77b93b2ae073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d57b24-18d8-453d-9fa9-7041f9d98525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d57b24-18d8-453d-9fa9-7041f9d98525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692db72d-0da2-4cfa-8992-9a0326e238e4', 'volume_name': 'volume-692db72d-0da2-4cfa-8992-9a0326e238e4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d3cf5b-bbfc-4d5b-aa07-25d6315e3518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d3cf5b-bbfc-4d5b-aa07-25d6315e3518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22987c8-500c-4aa0-8168-a98d4e66563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Volume 692db72d-0da2-4cfa-8992-9a0326e238e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692db72d-0da2-4cfa-8992-9a0326e238e4', 'volume_size': 1} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545791706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692db72d-0da2-4cfa-8992-9a0326e238e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0283d5b2de5f409bb3eaa137ca806a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:44Z,use_quota=True,user_id='6eb0610a41a849c9aeb8106288917edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Creating volume 692db72d-0da2-4cfa-8992-9a0326e238e4 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:34:44 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:44 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 1073741824 Jul 17 05:34:44 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:44 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 1073741824" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:45 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 Jul 17 05:34:45 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:45 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22987c8-500c-4aa0-8168-a98d4e66563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692db72d-0da2-4cfa-8992-9a0326e238e4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2e16d2-59ac-4ba7-8cb2-50b12dfa0358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Volume volume-692db72d-0da2-4cfa-8992-9a0326e238e4 (692db72d-0da2-4cfa-8992-9a0326e238e4): created successfully Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2e16d2-59ac-4ba7-8cb2-50b12dfa0358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Flow 'volume_create_manager' (7cafc927-e903-435f-9715-faaf684d0b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-66feb88e-36ea-4e2f-bab0-8c27bb2d21be tempest-VolumeQuotasAdminTestJSON-624609672 None] Created volume successfully. Jul 17 05:34:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Acquiring lock "cinder-692db72d-0da2-4cfa-8992-9a0326e238e4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "cinder-692db72d-0da2-4cfa-8992-9a0326e238e4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Acquiring lock "cinder-quobyte-692db72d-0da2-4cfa-8992-9a0326e238e4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "cinder-quobyte-692db72d-0da2-4cfa-8992-9a0326e238e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d233608-114a-495c-b7e2-5ba0421529f3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:46 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 Jul 17 05:34:46 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:47 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4" returned: 0 in 0.578s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:47 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4 Jul 17 05:34:47 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:47 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-692db72d-0da2-4cfa-8992-9a0326e238e4" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "cinder-quobyte-692db72d-0da2-4cfa-8992-9a0326e238e4" released by "delete_volume" :: held 0.978s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Created reservations ['2068cfaa-67ef-4637-b73e-ccf780564dcd', 'b014310a-b00d-4bf7-9d45-88727decaa6e', '52ede817-d669-425c-a516-ddbc2fe266c7', '53aedd0d-daea-4b8b-83e4-a74678c2ca43'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:47 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:34:47 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:48 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:34:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Deleted volume successfully. Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3a8d3377-fd28-4aa8-87b6-83409b953918 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "cinder-692db72d-0da2-4cfa-8992-9a0326e238e4-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Flow 'volume_create_manager' (fe61a429-c247-45f3-9cf3-4c62b560bcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705bb0f-209d-4c69-b814-78edcacf24bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1705bb0f-209d-4c69-b814-78edcacf24bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-382188041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2b9670-c7c1-4452-b3e7-658fe6f17087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1fe936529c4b278534b6f9ee9b53c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:48Z,use_quota=True,user_id='c0d1f0d8d7c2483d9d8f9763c98c87b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac86959-0a49-49c7-b005-938bbf585fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac86959-0a49-49c7-b005-938bbf585fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fe036f-1dd4-45eb-9a1c-06b1224dbd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fe036f-1dd4-45eb-9a1c-06b1224dbd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2b9670-c7c1-4452-b3e7-658fe6f17087', 'volume_name': 'volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045e7b77-d523-4139-96c3-2640de501df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045e7b77-d523-4139-96c3-2640de501df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37256037-89c4-4afe-8742-2bc72226d43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Volume 4d2b9670-c7c1-4452-b3e7-658fe6f17087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087', 'volume_size': 1} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-382188041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2b9670-c7c1-4452-b3e7-658fe6f17087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae1fe936529c4b278534b6f9ee9b53c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:48Z,use_quota=True,user_id='c0d1f0d8d7c2483d9d8f9763c98c87b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Creating volume 4d2b9670-c7c1-4452-b3e7-658fe6f17087 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:34:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:34:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:48 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 1073741824 Jul 17 05:34:48 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:49 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 1073741824" returned: 0 in 0.622s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:49 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 Jul 17 05:34:49 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:49 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087" returned: 0 in 0.570s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37256037-89c4-4afe-8742-2bc72226d43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7728f66-e3c7-4175-9d73-7efb703c393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Flow 'volume_create_manager' (0b39c65b-43c1-496c-88e0-4809492079de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f2941c-893a-429d-b775-e8d1ff05b8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Volume volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 (4d2b9670-c7c1-4452-b3e7-658fe6f17087): created successfully Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7728f66-e3c7-4175-9d73-7efb703c393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Flow 'volume_create_manager' (fe61a429-c247-45f3-9cf3-4c62b560bcaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f2941c-893a-429d-b775-e8d1ff05b8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-100736153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67768999-5b6b-461e-80c7-b991da590d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0283d5b2de5f409bb3eaa137ca806a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:50Z,use_quota=True,user_id='6eb0610a41a849c9aeb8106288917edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b90155-0470-43cc-95d0-964eea923cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b90155-0470-43cc-95d0-964eea923cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbe4420-c94f-4016-a46a-3240edf962e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbe4420-c94f-4016-a46a-3240edf962e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67768999-5b6b-461e-80c7-b991da590d60', 'volume_name': 'volume-67768999-5b6b-461e-80c7-b991da590d60', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2faaaa-7d9f-4d97-b1d6-1ee6fdbb969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2faaaa-7d9f-4d97-b1d6-1ee6fdbb969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ed7b7c-19b1-4e28-993c-1ca7e62444e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Volume 67768999-5b6b-461e-80c7-b991da590d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67768999-5b6b-461e-80c7-b991da590d60', 'volume_size': 1} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-100736153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67768999-5b6b-461e-80c7-b991da590d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0283d5b2de5f409bb3eaa137ca806a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:34:50Z,use_quota=True,user_id='6eb0610a41a849c9aeb8106288917edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Creating volume 67768999-5b6b-461e-80c7-b991da590d60 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:34:50 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b397b454-9792-431e-be59-933920c81d5d tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Created volume successfully. Jul 17 05:34:50 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 1073741824 Jul 17 05:34:50 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:50 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 1073741824" returned: 0 in 0.928s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:51 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 Jul 17 05:34:51 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:51 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60" returned: 0 in 0.560s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ed7b7c-19b1-4e28-993c-1ca7e62444e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67768999-5b6b-461e-80c7-b991da590d60', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d74219-a8f0-414b-9e8e-6dd51a930423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:34:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Volume volume-67768999-5b6b-461e-80c7-b991da590d60 (67768999-5b6b-461e-80c7-b991da590d60): created successfully Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d74219-a8f0-414b-9e8e-6dd51a930423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:34:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Flow 'volume_create_manager' (0b39c65b-43c1-496c-88e0-4809492079de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:34:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2cb4771e-91af-4e66-92a4-939544643e27 tempest-VolumeQuotasAdminTestJSON-624609672 None] Created volume successfully. Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-f684a961-20b6-4f27-8e48-aa3d8e1d7f32 req-abaf73b8-7652-4746-a2ec-36c7c11f42dc tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-f684a961-20b6-4f27-8e48-aa3d8e1d7f32 req-abaf73b8-7652-4746-a2ec-36c7c11f42dc tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-f684a961-20b6-4f27-8e48-aa3d8e1d7f32 req-abaf73b8-7652-4746-a2ec-36c7c11f42dc tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-f684a961-20b6-4f27-8e48-aa3d8e1d7f32 req-abaf73b8-7652-4746-a2ec-36c7c11f42dc tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '141317a8-c995-4d2d-be45-1442419d0142', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:34:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-f684a961-20b6-4f27-8e48-aa3d8e1d7f32 req-abaf73b8-7652-4746-a2ec-36c7c11f42dc tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] attachment_update completed successfully. Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5859565-1ccb-4a78-a254-e4007101baa2 tempest-VolumesActionsTest-1147469560 None] Acquiring lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f" by "attach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5859565-1ccb-4a78-a254-e4007101baa2 tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f" acquired by "attach_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d5859565-1ccb-4a78-a254-e4007101baa2 tempest-VolumesActionsTest-1147469560 None] Attaching volume 6623dce0-2c19-4b43-ba29-90e33ef5d01f to instance 4b502fc6-c38b-4199-906c-eaf385a9d70d at mountpoint /dev/vdb on host None. Jul 17 05:34:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d5859565-1ccb-4a78-a254-e4007101baa2 tempest-VolumesActionsTest-1147469560 None] Attach volume completed successfully. Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5859565-1ccb-4a78-a254-e4007101baa2 tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f" released by "attach_volume" :: held 0.191s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-79358f40-325c-467e-b1db-7363aee3be0b tempest-VolumesActionsTest-1147469560 None] Acquiring lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-79358f40-325c-467e-b1db-7363aee3be0b tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-79358f40-325c-467e-b1db-7363aee3be0b tempest-VolumesActionsTest-1147469560 None] Detaching volume 6623dce0-2c19-4b43-ba29-90e33ef5d01f from instance 4b502fc6-c38b-4199-906c-eaf385a9d70d. Jul 17 05:34:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-79358f40-325c-467e-b1db-7363aee3be0b tempest-VolumesActionsTest-1147469560 None] Detach volume completed successfully. Jul 17 05:34:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-79358f40-325c-467e-b1db-7363aee3be0b tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d18ed617-176e-4bdd-8229-f2fc438faf8f tempest-VolumeQuotasAdminTestJSON-875655482 None] Transfer volume completed successfully. Jul 17 05:34:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Acquiring lock "cinder-67768999-5b6b-461e-80c7-b991da590d60-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Lock "cinder-67768999-5b6b-461e-80c7-b991da590d60-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Acquiring lock "cinder-quobyte-67768999-5b6b-461e-80c7-b991da590d60" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Lock "cinder-quobyte-67768999-5b6b-461e-80c7-b991da590d60" acquired by "delete_volume" :: waited 0.045s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e8924-82d9-47d5-bb17-5ce9242fe11a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:54 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 Jul 17 05:34:54 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:55 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60" returned: 0 in 0.631s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:55 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60 Jul 17 05:34:55 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:55 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-67768999-5b6b-461e-80c7-b991da590d60" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Lock "cinder-quobyte-67768999-5b6b-461e-80c7-b991da590d60" released by "delete_volume" :: held 1.253s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Created reservations ['d8e40732-941b-4ec2-9927-76aacdefc19d', 'cbe27d26-99ab-414b-9431-35a8dcfcc8bd', '502d1158-45a3-4fa7-b6e9-355289b032f9', '7743695e-7d72-4769-97f9-9bb56caba16d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:55 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:34:55 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:56 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.432s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:34:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Deleted volume successfully. Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d6265135-c771-4767-b51b-852622edc901 tempest-VolumeQuotasAdminTestJSON-1468088519 None] Lock "cinder-67768999-5b6b-461e-80c7-b991da590d60-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:56 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:34:56 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:56 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:34:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:34:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-7a4a0345-6ee7-483b-84ec-211416e37cb9 req-ab2f1555-c68d-4351-b45d-49a02a0cde74 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Terminate volume connection completed successfully. Jul 17 05:34:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-7a4a0345-6ee7-483b-84ec-211416e37cb9 req-ab2f1555-c68d-4351-b45d-49a02a0cde74 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Deleting attachment 141317a8-c995-4d2d-be45-1442419d0142. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:34:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Acquiring lock "cinder-4d2b9670-c7c1-4452-b3e7-658fe6f17087-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "cinder-4d2b9670-c7c1-4452-b3e7-658fe6f17087-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Acquiring lock "cinder-quobyte-4d2b9670-c7c1-4452-b3e7-658fe6f17087" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:34:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "cinder-quobyte-4d2b9670-c7c1-4452-b3e7-658fe6f17087" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:34:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f41d6-97d4-40a6-bd81-c79469557206]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:34:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:58 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 Jul 17 05:34:58 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:58 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087" returned: 0 in 0.527s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:58 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087 Jul 17 05:34:58 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:58 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4d2b9670-c7c1-4452-b3e7-658fe6f17087" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "cinder-quobyte-4d2b9670-c7c1-4452-b3e7-658fe6f17087" released by "delete_volume" :: held 0.943s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:34:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Created reservations ['c3ccd7e3-0351-4f8f-b765-dcc6f3e7be28', '086b7f32-f6dd-4da7-953a-dff22f564088', '61d15534-bb0b-4462-895e-f0521486c93d', 'd17bd3b5-49b0-45b7-b97e-361d3b483329'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:34:59 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:34:59 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:34:59 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:34:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Deleted volume successfully. Jul 17 05:34:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e49d5f20-e66e-4f76-8f6c-c44566ef3c92 tempest-TestServerVolumeAttachScenarioOldVersion-1297096745 None] Lock "cinder-4d2b9670-c7c1-4452-b3e7-658fe6f17087-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:35:08 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=49,cinder:SELECT=46,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:35:09 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=48,cinder:UPDATE=41,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:35:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba0923cc-8c95-4886-bf6f-3236811f3b86 tempest-VolumesActionsTest-1147469560 None] Acquiring lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f" by "attach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:35:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba0923cc-8c95-4886-bf6f-3236811f3b86 tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f" acquired by "attach_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:35:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ba0923cc-8c95-4886-bf6f-3236811f3b86 tempest-VolumesActionsTest-1147469560 None] Attaching volume 6623dce0-2c19-4b43-ba29-90e33ef5d01f to instance de1c8e80-3fa2-469f-afbf-570b6730e97b at mountpoint /dev/vdb on host None. Jul 17 05:35:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ba0923cc-8c95-4886-bf6f-3236811f3b86 tempest-VolumesActionsTest-1147469560 None] Attach volume completed successfully. Jul 17 05:35:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba0923cc-8c95-4886-bf6f-3236811f3b86 tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f" released by "attach_volume" :: held 0.146s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a40e7fae-a86b-479e-b160-bd10930e0f7c tempest-VolumesActionsTest-1147469560 None] Acquiring lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a40e7fae-a86b-479e-b160-bd10930e0f7c tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:35:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a40e7fae-a86b-479e-b160-bd10930e0f7c tempest-VolumesActionsTest-1147469560 None] Detaching volume 6623dce0-2c19-4b43-ba29-90e33ef5d01f from instance de1c8e80-3fa2-469f-afbf-570b6730e97b. Jul 17 05:35:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a40e7fae-a86b-479e-b160-bd10930e0f7c tempest-VolumesActionsTest-1147469560 None] Detach volume completed successfully. Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a40e7fae-a86b-479e-b160-bd10930e0f7c tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Flow 'volume_create_manager' (295e6f3f-1660-4a7f-8f5e-442d85e4630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b568ac-a61c-4bb8-b9ec-4546b03dfd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b568ac-a61c-4bb8-b9ec-4546b03dfd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-779088126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311c27a8-4197-44e7-a172-7f92b643ca78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1815996f16343a7b79e30deb69de828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:12Z,use_quota=True,user_id='75df4dbe8c6249df908e049c0c9191b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52fa2300-3132-4f4a-a993-e189f2614675),volume_type_id=52fa2300-3132-4f4a-a993-e189f2614675)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1b790f-8f3b-4878-a4fa-34ac5c3fe543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1b790f-8f3b-4878-a4fa-34ac5c3fe543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baebad0d-27f1-4586-80cd-e9cb661d51dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baebad0d-27f1-4586-80cd-e9cb661d51dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311c27a8-4197-44e7-a172-7f92b643ca78', 'volume_name': 'volume-311c27a8-4197-44e7-a172-7f92b643ca78', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4425ea7-f12a-4f98-9a73-14ef2308625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4425ea7-f12a-4f98-9a73-14ef2308625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96274dc3-8e99-4605-8469-a933bcd8b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Volume 311c27a8-4197-44e7-a172-7f92b643ca78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311c27a8-4197-44e7-a172-7f92b643ca78', 'volume_size': 1} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-779088126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311c27a8-4197-44e7-a172-7f92b643ca78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1815996f16343a7b79e30deb69de828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:12Z,use_quota=True,user_id='75df4dbe8c6249df908e049c0c9191b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52fa2300-3132-4f4a-a993-e189f2614675),volume_type_id=52fa2300-3132-4f4a-a993-e189f2614675)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Creating volume 311c27a8-4197-44e7-a172-7f92b643ca78 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:35:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:35:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:12 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 1073741824 Jul 17 05:35:12 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:13 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 1073741824" returned: 0 in 1.018s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:13 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 Jul 17 05:35:13 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:13 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96274dc3-8e99-4605-8469-a933bcd8b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311c27a8-4197-44e7-a172-7f92b643ca78', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb99353-e001-49e4-84e6-357a8f8a0580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Volume volume-311c27a8-4197-44e7-a172-7f92b643ca78 (311c27a8-4197-44e7-a172-7f92b643ca78): created successfully Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb99353-e001-49e4-84e6-357a8f8a0580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Flow 'volume_create_manager' (295e6f3f-1660-4a7f-8f5e-442d85e4630c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d413ef4b-6f9e-424e-a8be-c5b830366a95 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Created volume successfully. Jul 17 05:35:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:35:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:35:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:14 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:35:14 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:15 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.482s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:15 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:35:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2df838f0-625e-42fb-a80e-03bb9a846ca0 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Retype volume completed successfully. Jul 17 05:35:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Acquiring lock "cinder-311c27a8-4197-44e7-a172-7f92b643ca78-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "cinder-311c27a8-4197-44e7-a172-7f92b643ca78-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Acquiring lock "cinder-quobyte-311c27a8-4197-44e7-a172-7f92b643ca78" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "cinder-quobyte-311c27a8-4197-44e7-a172-7f92b643ca78" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699fa86-6741-429e-9c80-a031f2bfeb41]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:16 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 Jul 17 05:35:16 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:16 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:16 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78 Jul 17 05:35:16 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:16 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-311c27a8-4197-44e7-a172-7f92b643ca78" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "cinder-quobyte-311c27a8-4197-44e7-a172-7f92b643ca78" released by "delete_volume" :: held 0.743s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:35:16 devstack cinder-volume[87750]: WARNING cinder.quota [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:35:16 devstack cinder-volume[87750]: WARNING cinder.quota [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:35:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Created reservations ['a2988543-8288-4919-80b5-c80aeb6f9ec1', 'ec09d74d-f1c9-4037-a980-f59d3ec528da', '0e8fcf1b-4b2d-4445-8d01-4aebdcffb9d6', '52dc6328-cf9a-4c63-8daf-042cae072b70'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:17 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:35:17 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:17 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:35:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Deleted volume successfully. Jul 17 05:35:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aeb0e915-9de8-4e32-81a8-54a052e05945 tempest-VolumeRetypeWithoutMigrationTest-1756225843 None] Lock "cinder-311c27a8-4197-44e7-a172-7f92b643ca78-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:35:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3471d0b4-5500-4de5-aff5-64e7e1da25c3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:18 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:35:18 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:19 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.501s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4bce3f-e8d3-455d-a5e7-9844536be2b8]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:19 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:35:19 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:19 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.487s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.1cd11575-826c-4e8d-955d-7980c2b244bdvnj1y7hg.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:19 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.1cd11575-826c-4e8d-955d-7980c2b244bdvnj1y7hg.img Jul 17 05:35:19 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:25 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.1cd11575-826c-4e8d-955d-7980c2b244bdvnj1y7hg.img" returned: 0 in 6.216s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0440bf4-8040-483e-afa3-2acb38fcc6e7]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:25 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:35:25 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:26 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.621s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:26 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.1cd11575-826c-4e8d-955d-7980c2b244bdvnj1y7hg.img {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:35:26 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Converted 1024.00 MB image at 164.69 MB/s Jul 17 05:35:26 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] 1cd11575-826c-4e8d-955d-7980c2b244bd was raw, no need to convert to raw {{(pid=87750) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Flow 'volume_create_manager' (29e8a62f-50b4-4ce4-9285-20ccc21f8543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807a8ba0-f214-4fc3-b772-dd2cb14abb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807a8ba0-f214-4fc3-b772-dd2cb14abb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1617600131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd6e969-bc07-4a5f-ae83-902b378772a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06472ac4a3454923a0ffb0b6d73351bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:28Z,use_quota=True,user_id='66c9168578d5497c91a1bcc04b05800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c23bf1-9d96-415d-a543-f6e5ef4209de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c23bf1-9d96-415d-a543-f6e5ef4209de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc767a7-959a-44a9-96a6-d50077c97130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc767a7-959a-44a9-96a6-d50077c97130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd6e969-bc07-4a5f-ae83-902b378772a3', 'volume_name': 'volume-ffd6e969-bc07-4a5f-ae83-902b378772a3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22cf799-bfcb-4520-acac-360e9f29c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22cf799-bfcb-4520-acac-360e9f29c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a5c4fc-3a03-485b-8ede-f82d9a8f7e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Volume ffd6e969-bc07-4a5f-ae83-902b378772a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd6e969-bc07-4a5f-ae83-902b378772a3', 'volume_size': 1} Jul 17 05:35:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Flow 'volume_create_manager' (51e3beee-132c-4c67-b99a-44f152636841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4b48db-37be-4683-8fc4-40e140a4fa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4b48db-37be-4683-8fc4-40e140a4fa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1935797829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ecc56e-833d-4245-8372-2a45852925c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbcc8f8119245089a5be74ed808fd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:35Z,use_quota=True,user_id='83b67372fbf8415398f35cdc53a4c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45327b97-c7eb-47dd-8b9e-4fdd7ac6adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45327b97-c7eb-47dd-8b9e-4fdd7ac6adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2f5f86-3369-4026-88fd-b7bd81867dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2f5f86-3369-4026-88fd-b7bd81867dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ecc56e-833d-4245-8372-2a45852925c9', 'volume_name': 'volume-10ecc56e-833d-4245-8372-2a45852925c9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0de9fd-5792-4fb0-b629-a82cb5b0b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0de9fd-5792-4fb0-b629-a82cb5b0b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a914a3-e71e-4fb6-a0c4-3f5c3bec6e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Volume 10ecc56e-833d-4245-8372-2a45852925c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ecc56e-833d-4245-8372-2a45852925c9', 'volume_size': 1} Jul 17 05:35:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:44 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:INSERT=4,cinder:SELECT=21,cinder:UPDATE=21 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:35:44 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.776s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Uploaded volume to glance image-id: 1cd11575-826c-4e8d-955d-7980c2b244bd. {{(pid=87750) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.098s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1617600131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd6e969-bc07-4a5f-ae83-902b378772a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06472ac4a3454923a0ffb0b6d73351bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:28Z,use_quota=True,user_id='66c9168578d5497c91a1bcc04b05800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Creating volume ffd6e969-bc07-4a5f-ae83-902b378772a3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:35:49 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:49 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 1073741824 Jul 17 05:35:49 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-db829f41-d61c-4d5d-85c6-4c55e133867d tempest-VolumesActionsTest-1147469560 None] Copy volume to image completed successfully. Jul 17 05:35:49 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 1073741824" returned: 0 in 0.505s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:49 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 Jul 17 05:35:49 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:50 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.239s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1935797829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ecc56e-833d-4245-8372-2a45852925c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbcc8f8119245089a5be74ed808fd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:35Z,use_quota=True,user_id='83b67372fbf8415398f35cdc53a4c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Creating volume 10ecc56e-833d-4245-8372-2a45852925c9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:35:50 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a5c4fc-3a03-485b-8ede-f82d9a8f7e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd6e969-bc07-4a5f-ae83-902b378772a3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:50 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 1073741824 Jul 17 05:35:50 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180fef97-59af-4e2e-8ab1-1e0be0189d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Volume volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 (ffd6e969-bc07-4a5f-ae83-902b378772a3): created successfully Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180fef97-59af-4e2e-8ab1-1e0be0189d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Flow 'volume_create_manager' (29e8a62f-50b4-4ce4-9285-20ccc21f8543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bc39f3d9-1ec2-4f75-8426-dcd260bd2670 tempest-AttachVolumeNegativeTest-60718988 None] Created volume successfully. Jul 17 05:35:50 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 1073741824" returned: 0 in 0.524s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:50 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 Jul 17 05:35:50 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:51 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:35:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a914a3-e71e-4fb6-a0c4-3f5c3bec6e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ecc56e-833d-4245-8372-2a45852925c9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6718be99-0454-47c2-aba5-c2b83ebee290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Volume volume-10ecc56e-833d-4245-8372-2a45852925c9 (10ecc56e-833d-4245-8372-2a45852925c9): created successfully Jul 17 05:35:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6718be99-0454-47c2-aba5-c2b83ebee290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Flow 'volume_create_manager' (51e3beee-132c-4c67-b99a-44f152636841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-42e81b9a-02d2-4023-87bc-35019cf3f4a3 tempest-VolumesTransfersTest-1447883753 None] Created volume successfully. Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad04b85-d443-49d4-8ae7-75d073c5a876]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:52 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:35:52 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d7844324-71d8-4e5e-a9af-610e4b041c3a req-93825ba7-5eb1-4483-9495-43e75c244321 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:52 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.636s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf7fcc-6e22-4296-b9e8-5a96ca416468]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:52 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:35:52 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5a41cf0f-e5b9-4fc4-a8b6-e963d2c4f596 tempest-VolumesTransfersTest-636073469 None] Transfer volume completed successfully. Jul 17 05:35:53 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.418s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:53 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img Jul 17 05:35:53 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Flow 'volume_create_manager' (971e4e5e-93f6-4dd6-8807-aca8fad8cab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fd171f-a3bb-474d-8112-97a1f9942a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fd171f-a3bb-474d-8112-97a1f9942a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1977262880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72012674-bf73-4b10-a90f-e6aebba8a97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8d713b50e424cbfbbb24106080277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:54Z,use_quota=True,user_id='9c55c13fcd6f438dab88b648df76ffcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffa0aae-2984-4f71-b67c-943cde0e268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffa0aae-2984-4f71-b67c-943cde0e268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04c6e00-042d-4d57-80d2-b25d2000f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04c6e00-042d-4d57-80d2-b25d2000f286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72012674-bf73-4b10-a90f-e6aebba8a97b', 'volume_name': 'volume-72012674-bf73-4b10-a90f-e6aebba8a97b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cb7dbc-3cd3-4d35-8a08-ce4bb00aa7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cb7dbc-3cd3-4d35-8a08-ce4bb00aa7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc58a7-6635-4cdf-81e2-9ffaa94953f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Volume 72012674-bf73-4b10-a90f-e6aebba8a97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72012674-bf73-4b10-a90f-e6aebba8a97b', 'volume_size': 1} Jul 17 05:35:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Flow 'volume_create_manager' (1a14b085-4b7d-427f-a9d7-00307e471b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b367ac-20c8-46f8-92fb-0ffbf29b103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b367ac-20c8-46f8-92fb-0ffbf29b103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1603493317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefc1c35-fe40-4206-bcd2-c4a823ba3fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8d713b50e424cbfbbb24106080277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:56Z,use_quota=True,user_id='9c55c13fcd6f438dab88b648df76ffcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e777b519-b73c-4257-b908-3cd53689af28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e777b519-b73c-4257-b908-3cd53689af28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ac52e6-1daf-4d8d-8067-4071ccdb61cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ac52e6-1daf-4d8d-8067-4071ccdb61cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aefc1c35-fe40-4206-bcd2-c4a823ba3fe4', 'volume_name': 'volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3a14b9-a8b9-4aae-ade9-4ddbd99db180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3a14b9-a8b9-4aae-ade9-4ddbd99db180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ddf11b-333a-49a0-b30f-bad7e445ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Volume aefc1c35-fe40-4206-bcd2-c4a823ba3fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4', 'volume_size': 1} Jul 17 05:35:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Acquiring lock "cinder-10ecc56e-833d-4245-8372-2a45852925c9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-10ecc56e-833d-4245-8372-2a45852925c9-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Acquiring lock "cinder-quobyte-10ecc56e-833d-4245-8372-2a45852925c9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-quobyte-10ecc56e-833d-4245-8372-2a45852925c9" acquired by "delete_volume" :: waited 0.094s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:35:56 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:35:56 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cb624d-0ec2-4001-989c-d3cf41b747bf]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:56 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 Jul 17 05:35:56 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:57 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.764s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:35:57 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:35:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:35:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:35:57 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9" returned: 0 in 0.943s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:57 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9 Jul 17 05:35:57 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:58 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-10ecc56e-833d-4245-8372-2a45852925c9" returned: 0 in 0.588s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-quobyte-10ecc56e-833d-4245-8372-2a45852925c9" released by "delete_volume" :: held 1.659s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Created reservations ['d981f789-3102-45d6-a6a6-1dc6299ca043', 'b1387d39-997d-4cc5-afc0-e1ec40f6585d', '1797dde3-13c0-4a51-96dd-c614c7137554', '0e639978-6dec-4b60-9844-9e83b7b988b5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:58 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:35:58 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:58 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img" returned: 0 in 5.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[11173a5e-540b-40a5-a62f-7a02b73e8c2f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:58 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:35:58 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:58 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:35:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Deleted volume successfully. Jul 17 05:35:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-caabe60c-317a-45d4-9f94-ef23fbdad79d tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-10ecc56e-833d-4245-8372-2a45852925c9-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Flow 'volume_create_manager' (5d4a6aa0-e731-4ae4-b686-798092658c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831b49f-f583-4cb8-8a53-b4d9e6d0d172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831b49f-f583-4cb8-8a53-b4d9e6d0d172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-476889403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2863ce2-55d2-493f-856e-ac3a06278fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbcc8f8119245089a5be74ed808fd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:59Z,use_quota=True,user_id='83b67372fbf8415398f35cdc53a4c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7506d785-004f-4697-8abe-757734af32ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7506d785-004f-4697-8abe-757734af32ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f6abf6-089b-496b-b383-e4da98337e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f6abf6-089b-496b-b383-e4da98337e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2863ce2-55d2-493f-856e-ac3a06278fd3', 'volume_name': 'volume-f2863ce2-55d2-493f-856e-ac3a06278fd3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:59 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3eb7b7-6e01-42c6-b9d7-33f86f41dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3eb7b7-6e01-42c6-b9d7-33f86f41dac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b8f4d-c44b-4145-bf9f-f62b5667bf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:35:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Volume f2863ce2-55d2-493f-856e-ac3a06278fd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2863ce2-55d2-493f-856e-ac3a06278fd3', 'volume_size': 1} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.685s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:35:59 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Converted 1024.00 MB image at 191.02 MB/s Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] 687701e4-3aed-491d-bcad-0b9c347f576a was raw, converting to qcow2 {{(pid=87750) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8454a71-45d5-48dd-8bc9-69660719d4a1]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:59 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img Jul 17 05:35:59 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:35:59 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:35:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:35:59 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img Jul 17 05:35:59 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:00 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img" returned: 1 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img /opt/stack/data/cinder/conversion/vol_upload_2rvzqimj {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:00 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img /opt/stack/data/cinder/conversion/vol_upload_2rvzqimj Jul 17 05:36:00 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:00 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img /opt/stack/data/cinder/conversion/vol_upload_2rvzqimj" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Image conversion details: src /opt/stack/data/cinder/conversion/6623dce0-2c19-4b43-ba29-90e33ef5d01f.temp_image.687701e4-3aed-491d-bcad-0b9c347f576awc00nb67.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2rvzqimj {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:36:00 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[69675ce0-3d6c-4158-999a-db41ca109318]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2rvzqimj {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:00 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2rvzqimj Jul 17 05:36:00 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:00 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2rvzqimj" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.120s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Uploaded volume to glance image-id: 687701e4-3aed-491d-bcad-0b9c347f576a. {{(pid=87750) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d7844324-71d8-4e5e-a9af-610e4b041c3a req-93825ba7-5eb1-4483-9495-43e75c244321 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.696s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d7844324-71d8-4e5e-a9af-610e4b041c3a req-93825ba7-5eb1-4483-9495-43e75c244321 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.631s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1977262880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72012674-bf73-4b10-a90f-e6aebba8a97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8d713b50e424cbfbbb24106080277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:54Z,use_quota=True,user_id='9c55c13fcd6f438dab88b648df76ffcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Creating volume 72012674-bf73-4b10-a90f-e6aebba8a97b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:02 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b7976a7c-3a69-4945-98a7-b237cfd740ac tempest-VolumesActionsTest-1147469560 None] Copy volume to image completed successfully. Jul 17 05:36:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-d7844324-71d8-4e5e-a9af-610e4b041c3a req-93825ba7-5eb1-4483-9495-43e75c244321 tempest-AttachVolumeNegativeTest-60718988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-ffd6e969-bc07-4a5f-ae83-902b378772a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b494aa5-2b2b-44d5-9a08-42c22e15dbb4', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:36:02 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b 1073741824 Jul 17 05:36:02 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-d7844324-71d8-4e5e-a9af-610e4b041c3a req-93825ba7-5eb1-4483-9495-43e75c244321 tempest-AttachVolumeNegativeTest-60718988 None] attachment_update completed successfully. Jul 17 05:36:03 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b 1073741824" returned: 0 in 0.730s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:03 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b Jul 17 05:36:03 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:03 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.615s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1603493317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefc1c35-fe40-4206-bcd2-c4a823ba3fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8d713b50e424cbfbbb24106080277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:56Z,use_quota=True,user_id='9c55c13fcd6f438dab88b648df76ffcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Creating volume aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc58a7-6635-4cdf-81e2-9ffaa94953f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72012674-bf73-4b10-a90f-e6aebba8a97b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:03 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 1073741824 Jul 17 05:36:03 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc05a100-bf44-4534-9e8d-aa74cea299fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Volume volume-72012674-bf73-4b10-a90f-e6aebba8a97b (72012674-bf73-4b10-a90f-e6aebba8a97b): created successfully Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc05a100-bf44-4534-9e8d-aa74cea299fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Flow 'volume_create_manager' (971e4e5e-93f6-4dd6-8807-aca8fad8cab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-51b856f8-2d9d-4867-a94d-0e26087b0268 tempest-TestServerVolumeAttachmentScenario-613983981 None] Created volume successfully. Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Acquiring lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Acquiring lock "cinder-quobyte-6623dce0-2c19-4b43-ba29-90e33ef5d01f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Lock "cinder-quobyte-6623dce0-2c19-4b43-ba29-90e33ef5d01f" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c1c042-582b-4a6a-85da-47be4f9eb73b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:04 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:36:04 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:04 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 1073741824" returned: 0 in 0.714s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:04 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 Jul 17 05:36:04 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:04 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.461s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:04 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f Jul 17 05:36:04 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:04 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.236s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-476889403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2863ce2-55d2-493f-856e-ac3a06278fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbcc8f8119245089a5be74ed808fd74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:35:59Z,use_quota=True,user_id='83b67372fbf8415398f35cdc53a4c6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Creating volume f2863ce2-55d2-493f-856e-ac3a06278fd3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:04 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ddf11b-333a-49a0-b30f-bad7e445ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:04 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 1073741824 Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fec721-b904-4d3f-8845-240cf894da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:04 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Volume volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 (aefc1c35-fe40-4206-bcd2-c4a823ba3fe4): created successfully Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fec721-b904-4d3f-8845-240cf894da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Flow 'volume_create_manager' (1a14b085-4b7d-427f-a9d7-00307e471b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6b4e616d-5b04-473c-b357-9dbd776e7791 tempest-TestServerVolumeAttachmentScenario-613983981 None] Created volume successfully. Jul 17 05:36:04 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6623dce0-2c19-4b43-ba29-90e33ef5d01f" returned: 0 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Lock "cinder-quobyte-6623dce0-2c19-4b43-ba29-90e33ef5d01f" released by "delete_volume" :: held 0.869s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Created reservations ['81d4568f-90d2-4c58-8db1-03d3c35c4c55', '974bf930-a11f-451a-a3ee-61b91980f83c', '8b584f55-a729-4a05-92ab-74e2a33f2c7a', '316fdf3d-61f1-4c06-a406-aaa9025ae8ce'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:04 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:04 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:05 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 1073741824" returned: 0 in 0.802s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:05 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Deleted volume successfully. Jul 17 05:36:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a0cb118a-bdb1-4dd8-bbee-1c14215dff1b tempest-VolumesActionsTest-1147469560 None] Lock "cinder-6623dce0-2c19-4b43-ba29-90e33ef5d01f-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:05 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 Jul 17 05:36:05 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-e3eec07d-b51d-4bb9-b023-0d499247c0dc req-5bd1650b-af81-44db-9875-8c435972750f tempest-AttachVolumeNegativeTest-60718988 None] Terminate volume connection completed successfully. Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-e3eec07d-b51d-4bb9-b023-0d499247c0dc req-5bd1650b-af81-44db-9875-8c435972750f tempest-AttachVolumeNegativeTest-60718988 None] Deleting attachment 9b494aa5-2b2b-44d5-9a08-42c22e15dbb4. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:36:06 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3" returned: 0 in 0.736s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b8f4d-c44b-4145-bf9f-f62b5667bf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2863ce2-55d2-493f-856e-ac3a06278fd3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275a2810-88f6-40bb-bb61-507cbf3a0b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:06 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Volume volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 (f2863ce2-55d2-493f-856e-ac3a06278fd3): created successfully Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275a2810-88f6-40bb-bb61-507cbf3a0b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Flow 'volume_create_manager' (5d4a6aa0-e731-4ae4-b686-798092658c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8058e6c2-f93d-477d-8a7b-522f51c59f38 tempest-VolumesTransfersTest-1447883753 None] Created volume successfully. Jul 17 05:36:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Acquiring lock "cinder-f2863ce2-55d2-493f-856e-ac3a06278fd3-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-f2863ce2-55d2-493f-856e-ac3a06278fd3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Acquiring lock "cinder-quobyte-f2863ce2-55d2-493f-856e-ac3a06278fd3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-quobyte-f2863ce2-55d2-493f-856e-ac3a06278fd3" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d6eba4-87ff-424a-9ec8-5bdba4d40e56]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:08 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 Jul 17 05:36:08 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:08 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3" returned: 0 in 0.721s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:09 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3 Jul 17 05:36:09 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:09 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f2863ce2-55d2-493f-856e-ac3a06278fd3" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-quobyte-f2863ce2-55d2-493f-856e-ac3a06278fd3" released by "delete_volume" :: held 1.274s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Created reservations ['bbd02fb5-6794-46b7-8e18-ddc55549fc04', 'c9aca9b1-3bc6-4620-a179-a7ed31cb60d7', 'a7ccc732-6b0f-434b-88d1-884a8c833013', '0d7c8fef-ff81-4fc2-97b4-033827d4e00d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:09 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:09 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:10 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.560s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Deleted volume successfully. Jul 17 05:36:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bccfc63b-7d71-4d80-a810-cb3ef2da54a1 tempest-VolumesTransfersTest-1689446166 None] Lock "cinder-f2863ce2-55d2-493f-856e-ac3a06278fd3-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "cinder-ffd6e969-bc07-4a5f-ae83-902b378772a3-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-ffd6e969-bc07-4a5f-ae83-902b378772a3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "cinder-quobyte-ffd6e969-bc07-4a5f-ae83-902b378772a3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-quobyte-ffd6e969-bc07-4a5f-ae83-902b378772a3" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0404b479-da64-4576-8523-1f8d06a258fa]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:14 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 Jul 17 05:36:14 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:14 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3" returned: 0 in 0.770s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:15 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3 Jul 17 05:36:15 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:15 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ffd6e969-bc07-4a5f-ae83-902b378772a3" returned: 0 in 0.449s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-quobyte-ffd6e969-bc07-4a5f-ae83-902b378772a3" released by "delete_volume" :: held 1.317s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Created reservations ['bab15d75-ccff-4d46-ab83-64bcf8331c41', '12b46f3a-915d-4c96-9184-598e70cc19ed', '9ec7ec5a-3547-4358-a286-af5f6c9b3785', '09cbd351-da8e-4aca-942e-77cbc0598581'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:15 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:15 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:16 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Deleted volume successfully. Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-917dd03e-587d-47cb-a6e5-850b0e7b5ed7 tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-ffd6e969-bc07-4a5f-ae83-902b378772a3-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "cinder-7f9fb075-5064-4de8-8fe4-0413a22b83bf-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-7f9fb075-5064-4de8-8fe4-0413a22b83bf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "cinder-quobyte-7f9fb075-5064-4de8-8fe4-0413a22b83bf" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-quobyte-7f9fb075-5064-4de8-8fe4-0413a22b83bf" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba2d14-5f78-4c1b-a557-c4cfd1c0acca]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:16 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf Jul 17 05:36:16 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:17 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf" returned: 0 in 0.561s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:17 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf Jul 17 05:36:17 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:17 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f9fb075-5064-4de8-8fe4-0413a22b83bf" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-quobyte-7f9fb075-5064-4de8-8fe4-0413a22b83bf" released by "delete_volume" :: held 0.916s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Created reservations ['f51a4625-0100-4179-aa98-8cc845876b7a', '7386a88c-f51a-4225-b509-210b38767985', '2baaf390-88a6-4f32-8a82-8019c6b5d518', '06b6ea84-470b-4846-9630-a0a3a459d062'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:17 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:17 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Flow 'volume_create_manager' (a424db20-3e86-4e31-889b-ec2c66af1217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0c1884-aaac-4525-b11b-bece72b19d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0c1884-aaac-4525-b11b-bece72b19d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1152277503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c748f97-191f-46c6-8a57-3092146cff41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efd5f4178864823b7c0061293075222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:18Z,use_quota=True,user_id='4673c4d3943c441d83a4776dfc705a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fda0e11-9e29-4957-a666-a732f7dde12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fda0e11-9e29-4957-a666-a732f7dde12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59300d58-9d70-4a2c-aa19-7fc832fd211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59300d58-9d70-4a2c-aa19-7fc832fd211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c748f97-191f-46c6-8a57-3092146cff41', 'volume_name': 'volume-6c748f97-191f-46c6-8a57-3092146cff41', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a32449-eba9-4dbb-b45a-18ca89f5eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a32449-eba9-4dbb-b45a-18ca89f5eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:18 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332aa2e0-a187-4f66-ae84-3315b931d197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Volume 6c748f97-191f-46c6-8a57-3092146cff41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c748f97-191f-46c6-8a57-3092146cff41', 'volume_size': 1} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1152277503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c748f97-191f-46c6-8a57-3092146cff41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efd5f4178864823b7c0061293075222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:18Z,use_quota=True,user_id='4673c4d3943c441d83a4776dfc705a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Creating volume 6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:18 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Deleted volume successfully. Jul 17 05:36:18 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 1073741824 Jul 17 05:36:18 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-023190b9-560f-4b98-86a5-9c0093bc8e0d tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-7f9fb075-5064-4de8-8fe4-0413a22b83bf-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:18 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 1073741824" returned: 0 in 0.596s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:18 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 Jul 17 05:36:18 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "cinder-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:19 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41" returned: 0 in 0.475s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332aa2e0-a187-4f66-ae84-3315b931d197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c748f97-191f-46c6-8a57-3092146cff41', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843967e3-1302-4fb0-aace-2ea000da933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:19 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Volume volume-6c748f97-191f-46c6-8a57-3092146cff41 (6c748f97-191f-46c6-8a57-3092146cff41): created successfully Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843967e3-1302-4fb0-aace-2ea000da933b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Flow 'volume_create_manager' (a424db20-3e86-4e31-889b-ec2c66af1217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "cinder-quobyte-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0c188d83-9f70-4e2d-b67b-3ff13989f0c8 tempest-VolumesCloneTest-1092811714 None] Created volume successfully. Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-quobyte-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[98deb6a7-caf9-48a2-a4c1-dd5f2aed01cc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:19 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 Jul 17 05:36:19 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:19 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100" returned: 0 in 0.424s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:19 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100 Jul 17 05:36:19 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:20 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-quobyte-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100" released by "delete_volume" :: held 0.807s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Created reservations ['3bef0f92-8f24-48c1-ae02-ade695aea545', '9757b0cd-7095-4192-844a-eb0fbe4fde60', '982ed59b-8cac-463c-b53b-db9b528c1bd6', '993cfbf7-7dc7-4e67-8da4-8fef9d7ea11d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:20 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:20 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Flow 'volume_create_manager' (1adfdafd-eabb-4bdd-a5f0-7dc22dac1698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b9e17d-fefb-4e5f-a413-d0fb70c95b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b9e17d-fefb-4e5f-a413-d0fb70c95b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-458179757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89324939-8bca-4d1c-b0da-aaebf75d1e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efd5f4178864823b7c0061293075222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6c748f97-191f-46c6-8a57-3092146cff41,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:21Z,use_quota=True,user_id='4673c4d3943c441d83a4776dfc705a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4ba709-0de8-4349-aff4-3a936c394d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4ba709-0de8-4349-aff4-3a936c394d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:20 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7530a6f-053d-4167-97c1-91cc6449f7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.494s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Deleted volume successfully. Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7530a6f-053d-4167-97c1-91cc6449f7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '89324939-8bca-4d1c-b0da-aaebf75d1e39', 'volume_name': 'volume-89324939-8bca-4d1c-b0da-aaebf75d1e39', 'volume_size': 2, 'source_volid': '6c748f97-191f-46c6-8a57-3092146cff41', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b276366e-837a-48ab-b7d9-9e029280fbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b276366e-837a-48ab-b7d9-9e029280fbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4944fce2-53ed-4cab-827e-2bd460a21d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Volume 89324939-8bca-4d1c-b0da-aaebf75d1e39: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-89324939-8bca-4d1c-b0da-aaebf75d1e39', 'volume_size': 2, 'source_volid': '6c748f97-191f-46c6-8a57-3092146cff41', 'source_volstatus': 'available'} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:21 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Cloning volume 6c748f97-191f-46c6-8a57-3092146cff41 to volume 89324939-8bca-4d1c-b0da-aaebf75d1e39 Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8f41de7f-9e72-4585-9673-227802584e1e tempest-AttachVolumeNegativeTest-60718988 None] Lock "cinder-2434222f-4e6f-4dd0-a1bf-2a2ed1be5100-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Flow 'volume_create_manager' (4efa6f9c-0601-4c20-99b4-ec74aa633afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e49c5c5-8e07-4934-b8e0-53b438c55dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e49c5c5-8e07-4934-b8e0-53b438c55dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1436753820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a3ccfd-16af-41d4-969b-f98ae1bd146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572df15ce58b4ee891720cad00f4432b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:21Z,use_quota=True,user_id='c1071ae6ee954d7f98c82e2f234f9798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0acb33-0554-4abe-8e80-d40131f428c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0acb33-0554-4abe-8e80-d40131f428c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0aba6b7-29e7-4a72-a119-00ac06f31a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Creating offline snapshot 22262cc1-b2e4-4027-a955-f3dcd04950b9 of volume 6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[470ddd92-716e-4f6b-9d88-f640448205d1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:21 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 Jul 17 05:36:21 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0aba6b7-29e7-4a72-a119-00ac06f31a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0a3ccfd-16af-41d4-969b-f98ae1bd146d', 'volume_name': 'volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03452ad7-bad6-4022-a13e-2d48661881b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03452ad7-bad6-4022-a13e-2d48661881b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20393ef7-8cae-4808-93f3-ec92ca7b51d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Volume f0a3ccfd-16af-41d4-969b-f98ae1bd146d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Trying to clone f0a3ccfd-16af-41d4-969b-f98ae1bd146d from image 574080f6-40fa-4386-bd5c-892273b66d56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:36:21 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:21 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 1G Jul 17 05:36:21 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:36:21 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Image download 20.69 MB at 20.69 MB/s Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1657859-9d28-45a3-8d03-9d7092c16566]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:22 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD Jul 17 05:36:22 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:22 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 1G" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c748f97-191f-46c6-8a57-3092146cff41 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:22 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c748f97-191f-46c6-8a57-3092146cff41 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 Jul 17 05:36:22 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:22 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 is fetched for user c1071ae6ee954d7f98c82e2f234f9798. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9832f4-77b9-40d4-83d5-fc61e0eeb7c1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:22 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c748f97-191f-46c6-8a57-3092146cff41 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:22 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 is being set with open permissions: ugo+rw Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:22 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 Jul 17 05:36:22 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:22 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD Jul 17 05:36:22 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:22 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9" returned: 0 in 0.270s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:22 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:22 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.info Jul 17 05:36:22 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:23 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.info" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:23 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.info is being set with open permissions: ugo+rw Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:23 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.info Jul 17 05:36:23 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:23 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.info" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "cinder-quobyte-89324939-8bca-4d1c-b0da-aaebf75d1e39" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-89324939-8bca-4d1c-b0da-aaebf75d1e39" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] snapshot: 22262cc1-b2e4-4027-a955-f3dcd04950b9, volume: 89324939-8bca-4d1c-b0da-aaebf75d1e39, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0c18c-24c5-4cf9-a558-06398b74238f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:23 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 Jul 17 05:36:23 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:23 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9" returned: 0 in 0.472s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c748f97-191f-46c6-8a57-3092146cff41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[833fddab-e808-4a71-bec6-1f7c0bcb0f36]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:24 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 Jul 17 05:36:24 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:24 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:24 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:36:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:24 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 Jul 17 05:36:24 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:30 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39" returned: 0 in 5.776s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[822651be-7662-4e15-9b15-1bcd4339af32]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:30 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 Jul 17 05:36:30 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:30 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41" returned: 0 in 0.580s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:30 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:36:30 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Converted 1024.00 MB image at 177.26 MB/s Jul 17 05:36:30 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 is being set with open permissions: ugo+rw Jul 17 05:36:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:30 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 Jul 17 05:36:30 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:30 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-89324939-8bca-4d1c-b0da-aaebf75d1e39" released by "_copy_volume_from_snapshot" :: held 7.636s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "cinder-quobyte-22262cc1-b2e4-4027-a955-f3dcd04950b9" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-22262cc1-b2e4-4027-a955-f3dcd04950b9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Deleting offline snapshot 22262cc1-b2e4-4027-a955-f3dcd04950b9 of volume 6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] snapshot_file for this snap is: volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ba4130-1300-45b2-98c0-c630ee445b86]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:31 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 Jul 17 05:36:31 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:31 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c748f97-191f-46c6-8a57-3092146cff41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4bccd7-8a2e-40e5-a41e-e5f7ed9b1bfd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:31 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 Jul 17 05:36:31 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:31 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:31 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 Jul 17 05:36:31 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:32 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:32 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9 Jul 17 05:36:32 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:32 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41.22262cc1-b2e4-4027-a955-f3dcd04950b9" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-22262cc1-b2e4-4027-a955-f3dcd04950b9" released by "_delete_snapshot" :: held 1.516s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.573s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.770s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1436753820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a3ccfd-16af-41d4-969b-f98ae1bd146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572df15ce58b4ee891720cad00f4432b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:21Z,use_quota=True,user_id='c1071ae6ee954d7f98c82e2f234f9798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Creating volume f0a3ccfd-16af-41d4-969b-f98ae1bd146d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:32 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4944fce2-53ed-4cab-827e-2bd460a21d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89324939-8bca-4d1c-b0da-aaebf75d1e39', 'volume_size': 2, 'source_volid': '6c748f97-191f-46c6-8a57-3092146cff41', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e901dea4-4e08-49d4-a99f-fbbd546f79cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:32 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 1073741824 Jul 17 05:36:32 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Volume volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 (89324939-8bca-4d1c-b0da-aaebf75d1e39): created successfully Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e901dea4-4e08-49d4-a99f-fbbd546f79cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Flow 'volume_create_manager' (1adfdafd-eabb-4bdd-a5f0-7dc22dac1698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6e73751b-b630-4ad6-9026-61b7765e8427 tempest-VolumesCloneTest-1092811714 None] Created volume successfully. Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Acquiring lock "cinder-89324939-8bca-4d1c-b0da-aaebf75d1e39-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Lock "cinder-89324939-8bca-4d1c-b0da-aaebf75d1e39-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Acquiring lock "cinder-quobyte-89324939-8bca-4d1c-b0da-aaebf75d1e39" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-89324939-8bca-4d1c-b0da-aaebf75d1e39" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca73c0-8ac3-4d9e-ace5-5a6bd9a65d65]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:33 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 1073741824" returned: 0 in 0.696s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:33 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 Jul 17 05:36:33 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:33 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d Jul 17 05:36:33 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:33 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" returned: 0 in 0.306s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Attempting download of 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume f0a3ccfd-16af-41d4-969b-f98ae1bd146d. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:36:33 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39" returned: 0 in 0.545s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4a7076-0b4b-4135-8f8a-bb5c29313ac7]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_d6o49w0t {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:33 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39 Jul 17 05:36:33 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:33 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_d6o49w0t Jul 17 05:36:33 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-e5ea5621-a736-4bb7-8c2d-6c251db2d1c5 req-75c1eebc-0af2-4a48-946f-6f41a860d2f4 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-e5ea5621-a736-4bb7-8c2d-6c251db2d1c5 req-75c1eebc-0af2-4a48-946f-6f41a860d2f4 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-e5ea5621-a736-4bb7-8c2d-6c251db2d1c5 req-75c1eebc-0af2-4a48-946f-6f41a860d2f4 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:34 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89324939-8bca-4d1c-b0da-aaebf75d1e39" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-89324939-8bca-4d1c-b0da-aaebf75d1e39" released by "delete_volume" :: held 0.967s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-e5ea5621-a736-4bb7-8c2d-6c251db2d1c5 req-75c1eebc-0af2-4a48-946f-6f41a860d2f4 tempest-TestServerVolumeAttachmentScenario-613983981 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-72012674-bf73-4b10-a90f-e6aebba8a97b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28b48f2b-99f9-49dc-bfa6-3dd5ffb6983c', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:36:34 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_d6o49w0t" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_d6o49w0t {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-e5ea5621-a736-4bb7-8c2d-6c251db2d1c5 req-75c1eebc-0af2-4a48-946f-6f41a860d2f4 tempest-TestServerVolumeAttachmentScenario-613983981 None] attachment_update completed successfully. Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Created reservations ['7795a7f5-cee4-4fb0-a6a2-df7d10eb12d5', 'df8c4f70-43b0-49a5-b18e-e11aed385e0e', '533b59e3-f3c1-4d0e-bc9d-6be5b9a747df', '3f2461cc-6bc1-4b9c-b7e7-3b24510a8f86'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:34 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_d6o49w0t Jul 17 05:36:34 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:34 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:34 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:34 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_d6o49w0t" returned: 1 in 0.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_d6o49w0t' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2b5ed7-abba-4243-97f2-878fc31ca52c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:34 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Deleted volume successfully. Jul 17 05:36:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1717373b-e9ea-43a4-82b2-7bf5406696bd tempest-VolumesCloneTest-1092811714 None] Lock "cinder-89324939-8bca-4d1c-b0da-aaebf75d1e39-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:34 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD Jul 17 05:36:34 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:35 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] 574080f6-40fa-4386-bd5c-892273b66d56 was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:35 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d Jul 17 05:36:35 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "cinder-6c748f97-191f-46c6-8a57-3092146cff41-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-6c748f97-191f-46c6-8a57-3092146cff41-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "cinder-quobyte-6c748f97-191f-46c6-8a57-3092146cff41" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-6c748f97-191f-46c6-8a57-3092146cff41" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3561b914-ce91-4b1e-87d3-ac57e25ad325]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:35 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 Jul 17 05:36:35 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:36 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41" returned: 0 in 0.576s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:36 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41 Jul 17 05:36:36 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:36 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6c748f97-191f-46c6-8a57-3092146cff41" returned: 0 in 0.315s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-quobyte-6c748f97-191f-46c6-8a57-3092146cff41" released by "delete_volume" :: held 0.957s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Created reservations ['3a40f9ab-31e4-4061-8518-067f4419a698', 'afc415f1-a789-4440-a7ec-76d71d913d9f', 'aa83eea9-b0c2-44fd-9f6a-7e99c92971e1', '39274ecf-2bbf-46c8-bcdc-b8fa47adc633'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:36 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:36 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:37 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Deleted volume successfully. Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1ee03d-faaf-4282-8145-c54f189af546 tempest-VolumesCloneTest-1092811714 None] Lock "cinder-6c748f97-191f-46c6-8a57-3092146cff41-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:37 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" returned: 0 in 2.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_zdlbv06zdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:36:37 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Converted 112.00 MB image at 50.17 MB/s Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:37 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 1G Jul 17 05:36:37 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:37 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 1G" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Downloaded image 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume f0a3ccfd-16af-41d4-969b-f98ae1bd146d successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 for user c1071ae6ee954d7f98c82e2f234f9798 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Marking volume f0a3ccfd-16af-41d4-969b-f98ae1bd146d as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Copying metadata from image 574080f6-40fa-4386-bd5c-892273b66d56 to f0a3ccfd-16af-41d4-969b-f98ae1bd146d. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Creating volume glance metadata for volume f0a3ccfd-16af-41d4-969b-f98ae1bd146d backed by image 574080f6-40fa-4386-bd5c-892273b66d56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20393ef7-8cae-4808-93f3-ec92ca7b51d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3407c1f2-463c-4413-b2ad-b56b96739386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Volume volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d (f0a3ccfd-16af-41d4-969b-f98ae1bd146d): created successfully Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3407c1f2-463c-4413-b2ad-b56b96739386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Flow 'volume_create_manager' (4efa6f9c-0601-4c20-99b4-ec74aa633afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7e8547ee-a7df-40ae-a02e-97b08ff06351 tempest-VolumesExtendTest-1028284797 None] Created volume successfully. Jul 17 05:36:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d8cd9e-362b-4c19-9144-791b86eeb993]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:38 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d Jul 17 05:36:38 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:39 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" returned: 0 in 0.522s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 2G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d 2G" returned: 0 in 0.160s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.732s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a0a3096d-cd0e-483d-a466-1aebdc252371 tempest-VolumesExtendTest-1028284797 None] Extend volume completed successfully. Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "cinder-f0a3ccfd-16af-41d4-969b-f98ae1bd146d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Lock "cinder-f0a3ccfd-16af-41d4-969b-f98ae1bd146d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "cinder-quobyte-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f0167d-c724-4b5f-936a-450400298698]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:40 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d Jul 17 05:36:40 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:40 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:40 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d Jul 17 05:36:40 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-dbd2df27-7ea5-4d6a-b40b-7b916ca5d0ec req-dcfc9ef2-fa67-4ddb-95eb-066b207583fe tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-dbd2df27-7ea5-4d6a-b40b-7b916ca5d0ec req-dcfc9ef2-fa67-4ddb-95eb-066b207583fe tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-dbd2df27-7ea5-4d6a-b40b-7b916ca5d0ec req-dcfc9ef2-fa67-4ddb-95eb-066b207583fe tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-dbd2df27-7ea5-4d6a-b40b-7b916ca5d0ec req-dcfc9ef2-fa67-4ddb-95eb-066b207583fe tempest-TestServerVolumeAttachmentScenario-613983981 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abd7dd92-8d49-468e-838e-412bd2292c91', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:36:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-dbd2df27-7ea5-4d6a-b40b-7b916ca5d0ec req-dcfc9ef2-fa67-4ddb-95eb-066b207583fe tempest-TestServerVolumeAttachmentScenario-613983981 None] attachment_update completed successfully. Jul 17 05:36:41 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-f0a3ccfd-16af-41d4-969b-f98ae1bd146d" released by "delete_volume" :: held 0.972s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Created reservations ['a4aa5ba9-9847-4bea-98b8-98e67297e63a', '984eaf15-a530-4467-82a3-de5acb7350e1', '8d858d95-1d50-4f98-b54d-b61afae7e9c8', 'c846e56d-56b5-4a73-b02f-f9c81193a53b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:41 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:41 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:41 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.379s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Deleted volume successfully. Jul 17 05:36:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ae96b2f-0834-44a5-8896-6169bdcb7bd0 tempest-VolumesExtendTest-1028284797 None] Lock "cinder-f0a3ccfd-16af-41d4-969b-f98ae1bd146d-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (07c74347-0f9d-4437-961f-c55b961c27d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02760880-36c4-47ae-aff2-7a0d1e608ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02760880-36c4-47ae-aff2-7a0d1e608ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1801600799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44443d2f-9755-4c37-8446-f752554b7138,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:42Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fea4e9-6bbc-4bba-9ff8-cfe3c1ec490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fea4e9-6bbc-4bba-9ff8-cfe3c1ec490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14718fa-7bab-4789-85a8-b4c219c08a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14718fa-7bab-4789-85a8-b4c219c08a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44443d2f-9755-4c37-8446-f752554b7138', 'volume_name': 'volume-44443d2f-9755-4c37-8446-f752554b7138', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef4e8a-d969-4d1c-9d81-ce8d424909e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef4e8a-d969-4d1c-9d81-ce8d424909e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6806a1-2f4c-4409-be02-01e5d4c8e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Volume 44443d2f-9755-4c37-8446-f752554b7138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44443d2f-9755-4c37-8446-f752554b7138', 'volume_size': 1} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1801600799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44443d2f-9755-4c37-8446-f752554b7138,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:42Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Creating volume 44443d2f-9755-4c37-8446-f752554b7138 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:42 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:42 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 1073741824 Jul 17 05:36:42 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:43 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 1073741824" returned: 0 in 0.615s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Flow 'volume_create_manager' (7946ae33-36f7-43d9-97da-e33b1bad63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f935a76-986d-493b-b5f1-72a3cc1c700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f935a76-986d-493b-b5f1-72a3cc1c700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-598944971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be8f421-ad51-42d8-b746-6950933ed1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572df15ce58b4ee891720cad00f4432b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:43Z,use_quota=True,user_id='c1071ae6ee954d7f98c82e2f234f9798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abe9cd7-25b6-4480-a601-8136c88cce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abe9cd7-25b6-4480-a601-8136c88cce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d199a02d-af39-42d3-9dae-94b93aa449df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d199a02d-af39-42d3-9dae-94b93aa449df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be8f421-ad51-42d8-b746-6950933ed1ad', 'volume_name': 'volume-3be8f421-ad51-42d8-b746-6950933ed1ad', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58d7f5d-4679-46db-a3d6-a8a93fb890a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58d7f5d-4679-46db-a3d6-a8a93fb890a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961d4023-dc80-4dc9-9a1d-19ef660d033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Volume 3be8f421-ad51-42d8-b746-6950933ed1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be8f421-ad51-42d8-b746-6950933ed1ad', 'volume_size': 1} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:43 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 Jul 17 05:36:43 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:43 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-598944971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be8f421-ad51-42d8-b746-6950933ed1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572df15ce58b4ee891720cad00f4432b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:43Z,use_quota=True,user_id='c1071ae6ee954d7f98c82e2f234f9798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Creating volume 3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6806a1-2f4c-4409-be02-01e5d4c8e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44443d2f-9755-4c37-8446-f752554b7138', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:43 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad 1073741824 Jul 17 05:36:43 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f388c555-7b3e-4138-a7fe-8200c956ae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Volume volume-44443d2f-9755-4c37-8446-f752554b7138 (44443d2f-9755-4c37-8446-f752554b7138): created successfully Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f388c555-7b3e-4138-a7fe-8200c956ae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (07c74347-0f9d-4437-961f-c55b961c27d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c5429e83-fe05-495e-8f20-a862f1cd18ae tempest-VolumesGetTest-1031853365 None] Created volume successfully. Jul 17 05:36:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-58184840-325a-488e-b547-231c86284383 req-9289f769-3cf9-4254-b248-3e96d8b97804 tempest-TestServerVolumeAttachmentScenario-613983981 None] Terminate volume connection completed successfully. Jul 17 05:36:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-58184840-325a-488e-b547-231c86284383 req-9289f769-3cf9-4254-b248-3e96d8b97804 tempest-TestServerVolumeAttachmentScenario-613983981 None] Deleting attachment abd7dd92-8d49-468e-838e-412bd2292c91. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:36:44 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad 1073741824" returned: 0 in 0.558s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:44 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad Jul 17 05:36:44 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:44 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961d4023-dc80-4dc9-9a1d-19ef660d033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be8f421-ad51-42d8-b746-6950933ed1ad', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac81001-30f2-4fa3-ac38-4ce522b64f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Volume volume-3be8f421-ad51-42d8-b746-6950933ed1ad (3be8f421-ad51-42d8-b746-6950933ed1ad): created successfully Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac81001-30f2-4fa3-ac38-4ce522b64f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Flow 'volume_create_manager' (7946ae33-36f7-43d9-97da-e33b1bad63c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f1aae939-e345-4b36-a129-9d3461471aae tempest-VolumesExtendTest-1028284797 None] Created volume successfully. Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=89,cinder:INSERT=36,cinder:UPDATE=121,cinder:DELETE=12 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=111,cinder:UPDATE=104,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (10589798-9a90-44cd-84db-8cdc130c1f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda2b542-87b5-4fe8-99b2-919bc93d02a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda2b542-87b5-4fe8-99b2-919bc93d02a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-277455630',display_name='tempest-VolumesGetTest-Volume-1190356480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a58bd94-fbac-49eb-864e-3f9ff7ec5d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:45Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349d0dec-5612-4519-a03e-dc5fa59991ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349d0dec-5612-4519-a03e-dc5fa59991ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b17398d-aa78-41e2-a5ec-3e413d37789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b17398d-aa78-41e2-a5ec-3e413d37789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a58bd94-fbac-49eb-864e-3f9ff7ec5d47', 'volume_name': 'volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6523fcb5-e508-49c3-be07-45ae4e58f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6523fcb5-e508-49c3-be07-45ae4e58f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad826c-f4e1-4ac5-9b03-0812dfbd4626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Volume 7a58bd94-fbac-49eb-864e-3f9ff7ec5d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47', 'volume_size': 1} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-277455630',display_name='tempest-VolumesGetTest-Volume-1190356480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a58bd94-fbac-49eb-864e-3f9ff7ec5d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:45Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Creating volume 7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:45 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:45 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 1073741824 Jul 17 05:36:45 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-6b3c3396-2c7e-46b3-97ae-fc54e93ceaf8 req-71d1d0ad-1f36-4155-82fe-3d0fdd78e5f0 tempest-TestServerVolumeAttachmentScenario-613983981 None] Terminate volume connection completed successfully. Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-6b3c3396-2c7e-46b3-97ae-fc54e93ceaf8 req-71d1d0ad-1f36-4155-82fe-3d0fdd78e5f0 tempest-TestServerVolumeAttachmentScenario-613983981 None] Deleting attachment 28b48f2b-99f9-49dc-bfa6-3dd5ffb6983c. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Flow 'volume_create_manager' (e8cb0f37-f142-4f0b-8f47-c6ae21561b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebce263-c71d-47ae-a334-f156fc521812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebce263-c71d-47ae-a334-f156fc521812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1872638165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc9c5279f5646a49598325f4471a734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:46Z,use_quota=True,user_id='400397d014354c4a86ee00ef7481cd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a2c9cda-8a6e-4ede-8b33-9f6eec68d7a2),volume_type_id=7a2c9cda-8a6e-4ede-8b33-9f6eec68d7a2)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2e8f6c-0038-4418-bbe4-bdde459cb654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2e8f6c-0038-4418-bbe4-bdde459cb654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffb7c5d-cd82-495a-a135-2dac1efaa0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffb7c5d-cd82-495a-a135-2dac1efaa0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3', 'volume_name': 'volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214f57e3-bdc0-4dfb-8b95-025e7835b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214f57e3-bdc0-4dfb-8b95-025e7835b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acae615f-e05e-4616-8058-2d556171a254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Volume 480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3', 'volume_size': 1} Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:45 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 1073741824" returned: 0 in 0.535s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:46 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 Jul 17 05:36:46 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:46 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.779s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad826c-f4e1-4ac5-9b03-0812dfbd4626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36774288-0470-414a-bf5a-994704abd719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Creating offline snapshot 022df083-4bfe-4380-8b4f-28f3d4fbac35 of volume 3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:36:46 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Volume volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 (7a58bd94-fbac-49eb-864e-3f9ff7ec5d47): created successfully Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36774288-0470-414a-bf5a-994704abd719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (10589798-9a90-44cd-84db-8cdc130c1f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3194bd6b-d796-4c16-a648-1cf9cf45ff6d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3b961cbe-0b00-4a0b-94d4-ed4393e2a0af tempest-VolumesGetTest-1031853365 None] Created volume successfully. Jul 17 05:36:46 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad Jul 17 05:36:46 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:46 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad" returned: 0 in 0.415s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:46 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 1G Jul 17 05:36:46 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:47 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 1G" returned: 0 in 0.602s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be8f421-ad51-42d8-b746-6950933ed1ad -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:47 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be8f421-ad51-42d8-b746-6950933ed1ad -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 Jul 17 05:36:47 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Lock "cinder-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e36114c-d0c1-462e-b41d-427011f97cd1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:47 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be8f421-ad51-42d8-b746-6950933ed1ad -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35" returned: 0 in 0.486s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:47 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 is being set with open permissions: ugo+rw Jul 17 05:36:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:47 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 Jul 17 05:36:47 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:47 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 Jul 17 05:36:47 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:48 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47" returned: 0 in 0.484s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:48 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:48 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47 Jul 17 05:36:48 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:48 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.info Jul 17 05:36:48 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:48 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47" released by "delete_volume" :: held 0.883s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:48 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Created reservations ['c8f12902-71cd-4f71-8dba-b494af12c5ad', '3827a780-13d2-4647-8a0d-55a7812f85f8', '3686f74e-7a74-48ff-81b1-e0817dcad9e5', '42fb15d9-0a97-4a4d-9fed-c20d03c86a5f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.info" returned: 0 in 0.346s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:48 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.info is being set with open permissions: ugo+rw Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:48 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.info Jul 17 05:36:48 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:48 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:48 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:49 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.info" returned: 0 in 0.328s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.769s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.135s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1872638165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc9c5279f5646a49598325f4471a734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:46Z,use_quota=True,user_id='400397d014354c4a86ee00ef7481cd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a2c9cda-8a6e-4ede-8b33-9f6eec68d7a2),volume_type_id=7a2c9cda-8a6e-4ede-8b33-9f6eec68d7a2)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Creating volume 480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:49 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:49 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:49 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 1073741824 Jul 17 05:36:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Deleted volume successfully. Jul 17 05:36:49 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-98a8c83c-689e-48b5-91d3-4da39664bc26 tempest-VolumesExtendTest-1028284797 None] Create snapshot completed successfully Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d943ee39-f5e8-44a2-a962-a9268b747e6d tempest-VolumesGetTest-1031853365 None] Lock "cinder-7a58bd94-fbac-49eb-864e-3f9ff7ec5d47-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:49 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 1073741824" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:49 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 Jul 17 05:36:49 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:49 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3" returned: 0 in 0.306s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.051s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acae615f-e05e-4616-8058-2d556171a254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6488ee99-f619-481b-b233-05ddecd6cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f9cac-628b-4490-8f46-1268986c95db]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-44443d2f-9755-4c37-8446-f752554b7138-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Volume volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 (480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3): created successfully Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6488ee99-f619-481b-b233-05ddecd6cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Flow 'volume_create_manager' (e8cb0f37-f142-4f0b-8f47-c6ae21561b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Lock "cinder-44443d2f-9755-4c37-8446-f752554b7138-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-54a2d41c-d08b-4ff4-8529-b6b7be8cc316 tempest-VolumeTypesAccessTest-211182630 None] Created volume successfully. Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-44443d2f-9755-4c37-8446-f752554b7138" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-44443d2f-9755-4c37-8446-f752554b7138" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd1687f-9225-46e6-a589-fa95ee760d58]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:50 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad Jul 17 05:36:50 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:50 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 Jul 17 05:36:50 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:50 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad" returned: 0 in 0.437s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 2G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:50 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "cinder-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:50 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138 Jul 17 05:36:50 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 2G" returned: 0 in 0.160s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.658s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "cinder-quobyte-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-quobyte-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f198a33-f397-4c99-a560-8f290c4eca9c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f8c152ac-7648-453d-a5b5-78f4eb5fe593 tempest-VolumesExtendTest-1028284797 None] Extend volume completed successfully. Jul 17 05:36:50 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 Jul 17 05:36:50 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:50 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-44443d2f-9755-4c37-8446-f752554b7138" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-44443d2f-9755-4c37-8446-f752554b7138" released by "delete_volume" :: held 0.718s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Created reservations ['9d716367-6601-40af-9ff1-e8b37bfcfbc4', 'a9c8a4e2-22b5-497f-b59b-217394a47641', '90252bdb-3882-4207-bca8-e8f55eeb9390', 'f738373f-84ba-4781-ad17-7c43a95bdc68'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:50 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:50 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:51 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4" returned: 0 in 0.417s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:51 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4 Jul 17 05:36:51 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Acquiring lock "cinder-022df083-4bfe-4380-8b4f-28f3d4fbac35-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Lock "cinder-022df083-4bfe-4380-8b4f-28f3d4fbac35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Acquiring lock "cinder-quobyte-3be8f421-ad51-42d8-b746-6950933ed1ad" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-3be8f421-ad51-42d8-b746-6950933ed1ad" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Acquiring lock "cinder-quobyte-022df083-4bfe-4380-8b4f-28f3d4fbac35" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-022df083-4bfe-4380-8b4f-28f3d4fbac35" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Deleting offline snapshot 022df083-4bfe-4380-8b4f-28f3d4fbac35 of volume 3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] snapshot_file for this snap is: volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391a471-bd82-4928-8fe5-07fa0a40f174]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:51 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.367s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Deleted volume successfully. Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Acquiring lock "cinder-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Lock "cinder-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a78e0beb-adca-49b0-aa87-1ca09915ef91 tempest-VolumesGetTest-1031853365 None] Lock "cinder-44443d2f-9755-4c37-8446-f752554b7138-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:51 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4" returned: 0 in 0.360s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Acquiring lock "cinder-quobyte-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-quobyte-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4" released by "delete_volume" :: held 0.828s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:51 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 Jul 17 05:36:51 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Lock "cinder-quobyte-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa435d6-f4ec-4167-925f-847b232b3ebc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Created reservations ['9e115516-8aff-4718-a02a-5758d6e4248f', 'a6244e21-cc19-467a-bbfb-288915a6ec3e', '96c3e42f-7d1a-4eb0-889e-d282669ed2ca', '3e6282ec-995b-4de8-a7dd-058050a7671b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:51 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 Jul 17 05:36:51 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:51 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:51 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "cinder-72012674-bf73-4b10-a90f-e6aebba8a97b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-72012674-bf73-4b10-a90f-e6aebba8a97b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:51 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35" returned: 0 in 0.587s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be8f421-ad51-42d8-b746-6950933ed1ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd275d6b-b5eb-4b6d-ab38-46dc7abe5d0f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "cinder-quobyte-72012674-bf73-4b10-a90f-e6aebba8a97b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-quobyte-72012674-bf73-4b10-a90f-e6aebba8a97b" acquired by "delete_volume" :: waited 0.045s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:51 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f41cc9e-66d9-4b66-b3d5-1f1404b0bdda]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3 Jul 17 05:36:52 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:52 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad Jul 17 05:36:52 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (e14075de-f345-4b6b-a2a7-d129f7c9c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e51909-0615-4f9b-83bd-16d2d5786540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:52 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.430s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e51909-0615-4f9b-83bd-16d2d5786540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1880114914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ca3ae8-db46-4dbf-a784-6d109004cd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:52Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392694da-7be6-4f3e-b1ef-6868fe63ccf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392694da-7be6-4f3e-b1ef-6868fe63ccf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba9ce9e-b16f-465d-99f4-114e64bb4d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba9ce9e-b16f-465d-99f4-114e64bb4d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ca3ae8-db46-4dbf-a784-6d109004cd0f', 'volume_name': 'volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:52 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b Jul 17 05:36:52 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5b9bad-f4dc-470f-bdeb-d1e5024755e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5b9bad-f4dc-470f-bdeb-d1e5024755e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c7bebc-aa9a-46b5-81c6-19ceb624ed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Volume 89ca3ae8-db46-4dbf-a784-6d109004cd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f', 'volume_size': 1} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1880114914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ca3ae8-db46-4dbf-a784-6d109004cd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:52Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Creating volume 89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:36:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Deleted volume successfully. Jul 17 05:36:52 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f 1073741824 Jul 17 05:36:52 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8971d818-d135-4664-87ec-606c66f86b8e tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-aefc1c35-fe40-4206-bcd2-c4a823ba3fe4-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:52 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3" returned: 0 in 0.309s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Lock "cinder-quobyte-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3" released by "delete_volume" :: held 0.857s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:52 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-884498336 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-884498336, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:36:52 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-884498336 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-884498336, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Created reservations ['ea1d356d-99fd-4a47-b5a7-cd6851aa6b37', '280ccccc-dad3-4535-8996-ceb467b4bb8a', '3d1b67a3-a97c-410c-b11e-75431ab43123', '63c7d40b-6b9d-426a-98e5-7348e09a2478'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:52 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad" returned: 0 in 0.528s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 Jul 17 05:36:52 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b" returned: 0 in 0.528s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:52 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b Jul 17 05:36:52 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f 1073741824" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f Jul 17 05:36:52 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:52 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Deleted volume successfully. Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4203a04-a3e2-41f4-8bc3-04e763ce5950 tempest-VolumeTypesAccessTest-211182630 None] Lock "cinder-480cd3f1-e7e3-4022-9ae3-e8cf8349dbf3-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:52 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-72012674-bf73-4b10-a90f-e6aebba8a97b" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-quobyte-72012674-bf73-4b10-a90f-e6aebba8a97b" released by "delete_volume" :: held 0.928s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:52 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35" returned: 0 in 0.531s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:52 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Created reservations ['c9ec204c-6615-4495-be20-8843441f6bd2', '1b645790-746a-45b0-9750-1cd0ed61b571', 'f77da048-6b3e-4943-b3fa-71dcc12a2cac', 'f6aec28f-6769-41de-bbfb-78495d6844ef'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:52 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35 Jul 17 05:36:52 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:53 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f" returned: 0 in 0.289s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c7bebc-aa9a-46b5-81c6-19ceb624ed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9e544d-1a4b-47f5-bcf2-ba714ed29817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Volume volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f (89ca3ae8-db46-4dbf-a784-6d109004cd0f): created successfully Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9e544d-1a4b-47f5-bcf2-ba714ed29817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (e14075de-f345-4b6b-a2a7-d129f7c9c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-51473b4c-29d9-475b-8eae-5e6cde16942d tempest-VolumesGetTest-1031853365 None] Created volume successfully. Jul 17 05:36:53 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:53 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:53 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad.022df083-4bfe-4380-8b4f-28f3d4fbac35" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-022df083-4bfe-4380-8b4f-28f3d4fbac35" released by "_delete_snapshot" :: held 2.051s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-3be8f421-ad51-42d8-b746-6950933ed1ad" released by "delete_snapshot" :: held 2.081s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Created reservations ['83d1460a-afbf-48fa-a7d9-4bccbd3fa3ee', '0a184917-ba34-43bc-b94e-b69566acb5da', '52584d5c-a69a-472f-8d7b-be18b218ef76', '464ceb96-0845-4bf0-ace6-f1ef2197a770'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:53 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Deleted volume successfully. Jul 17 05:36:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Delete snapshot completed successfully. Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-20b02078-6a63-4492-bd3f-52099799f360 tempest-TestServerVolumeAttachmentScenario-613983981 None] Lock "cinder-72012674-bf73-4b10-a90f-e6aebba8a97b-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c39f7a2c-fb47-488f-8780-aaaf392972ce tempest-VolumesExtendTest-1028284797 None] Lock "cinder-022df083-4bfe-4380-8b4f-28f3d4fbac35-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (b77700fa-0cf0-4498-a6ce-37dac784bdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a43d22-0035-4b22-bdcc-97c6d7b911ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Acquiring lock "cinder-3be8f421-ad51-42d8-b746-6950933ed1ad-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a43d22-0035-4b22-bdcc-97c6d7b911ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-100262133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0d54bc-94f1-4062-811c-07c53cac416a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=89ca3ae8-db46-4dbf-a784-6d109004cd0f,status='creating',terminated_at=None,updated_at=2026-07-17T03:36:54Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab782a84-ac48-49ef-b839-acba6e1d7bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab782a84-ac48-49ef-b839-acba6e1d7bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9373c2f1-32e4-460e-a1f1-5e5a06174514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Lock "cinder-3be8f421-ad51-42d8-b746-6950933ed1ad-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9373c2f1-32e4-460e-a1f1-5e5a06174514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5a0d54bc-94f1-4062-811c-07c53cac416a', 'volume_name': 'volume-5a0d54bc-94f1-4062-811c-07c53cac416a', 'volume_size': 1, 'source_volid': '89ca3ae8-db46-4dbf-a784-6d109004cd0f', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01ff5ed-4168-447f-ba26-a2d0eb6966ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01ff5ed-4168-447f-ba26-a2d0eb6966ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b96fb3-c24a-4471-a9d3-756cc0a7f37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:36:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Volume 5a0d54bc-94f1-4062-811c-07c53cac416a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5a0d54bc-94f1-4062-811c-07c53cac416a', 'volume_size': 1, 'source_volid': '89ca3ae8-db46-4dbf-a784-6d109004cd0f', 'source_volstatus': 'available'} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:54 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Cloning volume 89ca3ae8-db46-4dbf-a784-6d109004cd0f to volume 5a0d54bc-94f1-4062-811c-07c53cac416a Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Acquiring lock "cinder-quobyte-3be8f421-ad51-42d8-b746-6950933ed1ad" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Creating offline snapshot 64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 of volume 89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-3be8f421-ad51-42d8-b746-6950933ed1ad" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c899a2-f824-476a-a008-889fd35a6dc4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec44fffb-5d9e-4fcf-a415-f175a5f4b836]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:54 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f Jul 17 05:36:54 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:55 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad Jul 17 05:36:55 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:55 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f" returned: 0 in 0.467s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:55 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 1G Jul 17 05:36:55 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:55 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad" returned: 0 in 0.515s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:55 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad Jul 17 05:36:55 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:55 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3be8f421-ad51-42d8-b746-6950933ed1ad" returned: 0 in 0.398s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Lock "cinder-quobyte-3be8f421-ad51-42d8-b746-6950933ed1ad" released by "delete_volume" :: held 1.020s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Created reservations ['21cdec6a-d76d-4a9d-8719-cf76f48e0e19', '820830a2-cab3-422d-ab34-b3c8dfccbfe7', '7f1dc08d-f3b9-47f6-8479-fa49b104cf63', '767706f4-4b0e-464f-bcc6-3711f4bfdd69'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:36:55 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 1G" returned: 0 in 0.635s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:55 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 Jul 17 05:36:55 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:56 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:56 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:56 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:56 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 is being set with open permissions: ugo+rw Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:56 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 Jul 17 05:36:56 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:56 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.332s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Deleted volume successfully. Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:56 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:36:56 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-52020bf0-4dfa-4669-9970-8c91db9cdf6d tempest-VolumesExtendTest-1028284797 None] Lock "cinder-3be8f421-ad51-42d8-b746-6950933ed1ad-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:36:56 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:56 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:36:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:56 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.info Jul 17 05:36:56 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:57 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.info" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:57 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.info is being set with open permissions: ugo+rw Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:57 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.info Jul 17 05:36:57 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:57 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.info" returned: 0 in 0.481s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-5a0d54bc-94f1-4062-811c-07c53cac416a" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-5a0d54bc-94f1-4062-811c-07c53cac416a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] snapshot: 64f0178d-a8fa-4b7b-a60c-99716e4f0ca0, volume: 5a0d54bc-94f1-4062-811c-07c53cac416a, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e79293a-e7fc-4d36-8c4c-d48855bd3574]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:57 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 Jul 17 05:36:57 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:58 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" returned: 0 in 0.483s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a0496c-5e40-4b61-b019-9f7c56e2a6cc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:58 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f Jul 17 05:36:58 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:36:58 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f" returned: 0 in 0.425s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:36:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:36:58 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a Jul 17 05:36:58 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:04 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a" returned: 0 in 5.686s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d55870-7dca-4486-a5bb-4817e1386050]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:04 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f Jul 17 05:37:04 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:05 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f" returned: 0 in 0.716s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:37:05 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Converted 1024.00 MB image at 180.05 MB/s Jul 17 05:37:05 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a is being set with open permissions: ugo+rw Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:05 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a Jul 17 05:37:05 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:05 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-5a0d54bc-94f1-4062-811c-07c53cac416a" released by "_copy_volume_from_snapshot" :: held 7.869s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Deleting offline snapshot 64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 of volume 89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] snapshot_file for this snap is: volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec2cafa-ce5e-435d-9161-fbd351dfdd7b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:05 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 Jul 17 05:37:05 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:06 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" returned: 0 in 0.557s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:37:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[43060d4d-f2e3-4181-b1b5-d755852bb9d2]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:06 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f Jul 17 05:37:06 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:06 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:06 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 Jul 17 05:37:06 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:06 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=55,cinder:UPDATE=70,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:37:07 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:07 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0 Jul 17 05:37:07 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:07 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f.64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-64f0178d-a8fa-4b7b-a60c-99716e4f0ca0" released by "_delete_snapshot" :: held 2.009s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.849s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b96fb3-c24a-4471-a9d3-756cc0a7f37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0d54bc-94f1-4062-811c-07c53cac416a', 'volume_size': 1, 'source_volid': '89ca3ae8-db46-4dbf-a784-6d109004cd0f', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d9f7b1-44a1-48b6-935e-3ca28f511a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:07 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Volume volume-5a0d54bc-94f1-4062-811c-07c53cac416a (5a0d54bc-94f1-4062-811c-07c53cac416a): created successfully Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d9f7b1-44a1-48b6-935e-3ca28f511a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (b77700fa-0cf0-4498-a6ce-37dac784bdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-04dceb65-67ff-4576-bbb0-cdb6be4aebd1 tempest-VolumesGetTest-1031853365 None] Created volume successfully. Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (485ef7e0-a61e-41f1-b926-594e818a8529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db4ed2d-8471-4b88-95bd-af702dece42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db4ed2d-8471-4b88-95bd-af702dece42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-969038345',display_name='tempest-VolumesGetTest-Volume-1231918957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:09Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a289a-1319-4384-927d-3a7344a7fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a289a-1319-4384-927d-3a7344a7fca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a0634-278c-4c99-9d53-9577da9a78a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a0634-278c-4c99-9d53-9577da9a78a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1', 'volume_name': 'volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1710173-b6fe-49be-95b2-9bafbd23b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1710173-b6fe-49be-95b2-9bafbd23b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2527e8c-9753-4563-b8ed-3f6560bab484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Volume c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1', 'volume_size': 1} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-969038345',display_name='tempest-VolumesGetTest-Volume-1231918957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:09Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Creating volume c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:09 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:09 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 1073741824 Jul 17 05:37:09 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Flow 'volume_create_manager' (7237175c-c400-4bd0-b349-9a21a1a12d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d2abf2-6853-4da9-8611-4ab1325d6d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d2abf2-6853-4da9-8611-4ab1325d6d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-996046234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a328f373-8439-479f-bf2a-1e3b79b20354,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c14ae070ab1b4dba9f63c45861d074d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:09Z,use_quota=True,user_id='f0b2e5f4eefc496192c5a804a6da70d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e081c3e2-e995-4b1e-993a-4cd0e8dfad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e081c3e2-e995-4b1e-993a-4cd0e8dfad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2441f7-cc0a-472d-8b1b-941d34127b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2441f7-cc0a-472d-8b1b-941d34127b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a328f373-8439-479f-bf2a-1e3b79b20354', 'volume_name': 'volume-a328f373-8439-479f-bf2a-1e3b79b20354', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d837f6fd-1bb3-49bc-8cb3-37ad4c74d704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d837f6fd-1bb3-49bc-8cb3-37ad4c74d704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a71b46-d695-4c13-9a60-0861b343c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Volume a328f373-8439-479f-bf2a-1e3b79b20354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a328f373-8439-479f-bf2a-1e3b79b20354', 'volume_size': 1} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:09 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 1073741824" returned: 0 in 0.568s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:09 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 Jul 17 05:37:09 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:10 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-996046234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a328f373-8439-479f-bf2a-1e3b79b20354,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c14ae070ab1b4dba9f63c45861d074d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:09Z,use_quota=True,user_id='f0b2e5f4eefc496192c5a804a6da70d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Creating volume a328f373-8439-479f-bf2a-1e3b79b20354 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:10 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2527e8c-9753-4563-b8ed-3f6560bab484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31398b29-2b22-40e1-8279-454385dcbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:10 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 1073741824 Jul 17 05:37:10 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:10 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Volume volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 (c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1): created successfully Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31398b29-2b22-40e1-8279-454385dcbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (485ef7e0-a61e-41f1-b926-594e818a8529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-30871586-c929-45e8-b3ed-d9bd283ba1e8 tempest-VolumesGetTest-1031853365 None] Created volume successfully. Jul 17 05:37:10 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 1073741824" returned: 0 in 0.530s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:10 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 Jul 17 05:37:10 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:11 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a71b46-d695-4c13-9a60-0861b343c92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a328f373-8439-479f-bf2a-1e3b79b20354', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eab5a03-3850-4aad-a7c9-a2b4d12ca938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Volume volume-a328f373-8439-479f-bf2a-1e3b79b20354 (a328f373-8439-479f-bf2a-1e3b79b20354): created successfully Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eab5a03-3850-4aad-a7c9-a2b4d12ca938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Flow 'volume_create_manager' (7237175c-c400-4bd0-b349-9a21a1a12d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Lock "cinder-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-54cd37a4-573a-47df-b89e-2d16e0d8c11b tempest-VolumesListTestJSON-727217417 None] Created volume successfully. Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f376d6e-9af2-4e0b-a2bb-cd571198df00]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:11 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 Jul 17 05:37:11 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:11 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1" returned: 0 in 0.399s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:11 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1 Jul 17 05:37:11 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:12 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1" released by "delete_volume" :: held 0.750s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Created reservations ['1adf5335-714e-4f05-8fdb-957934677f43', 'e104fa36-69d4-4d38-86c1-9a29e17adec8', '2da92198-0edc-4c86-9d86-453d125c1e05', '8e5df1ad-2150-400e-a0e9-7ef1a405d0f0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (3d8ed942-2b14-477f-94be-b2f80a10cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969b9357-b68d-4b0c-84c1-a364935624cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969b9357-b68d-4b0c-84c1-a364935624cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172152117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8a456d-4b46-4fd5-990b-ac1701764bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:12Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daee789-f76a-441f-a4db-7c8196ff0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daee789-f76a-441f-a4db-7c8196ff0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f641a0ae-4c76-4945-a5d5-fb697ebdd5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f641a0ae-4c76-4945-a5d5-fb697ebdd5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc8a456d-4b46-4fd5-990b-ac1701764bbb', 'volume_name': 'volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd74b69-0a38-4cdc-9422-82a5bd73df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd74b69-0a38-4cdc-9422-82a5bd73df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd5c30-5b2d-45aa-bad7-5abe4a6e64a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Volume bc8a456d-4b46-4fd5-990b-ac1701764bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb', 'volume_size': 1} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172152117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8a456d-4b46-4fd5-990b-ac1701764bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:12Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Creating volume bc8a456d-4b46-4fd5-990b-ac1701764bbb {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:12 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:12 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb 1073741824 Jul 17 05:37:12 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:12 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:12 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-5a0d54bc-94f1-4062-811c-07c53cac416a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Lock "cinder-5a0d54bc-94f1-4062-811c-07c53cac416a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-5a0d54bc-94f1-4062-811c-07c53cac416a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-5a0d54bc-94f1-4062-811c-07c53cac416a" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c3e2c-b2f8-4347-b3bf-f41051320db5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:12 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Deleted volume successfully. Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-37e65b7a-fd31-43cd-9b42-5b2ff01a1c54 tempest-VolumesGetTest-1031853365 None] Lock "cinder-c1b8d38a-aa4e-4af1-9b7d-01a7e20bb7a1-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:12 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a Jul 17 05:37:12 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:12 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb 1073741824" returned: 0 in 0.662s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:13 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb Jul 17 05:37:13 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:13 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a" returned: 0 in 0.583s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:13 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a Jul 17 05:37:13 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:13 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Flow 'volume_create_manager' (4d55a774-1fcf-4132-bc97-a75af8a8fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d47f13-02b2-4a50-93d2-f4a628fa1cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d47f13-02b2-4a50-93d2-f4a628fa1cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-816385961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3358f8ef-f520-44e4-9892-09db9757a86f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c14ae070ab1b4dba9f63c45861d074d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:13Z,use_quota=True,user_id='f0b2e5f4eefc496192c5a804a6da70d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ec5aab-f97a-4ac9-b2c4-5b73717ba9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ec5aab-f97a-4ac9-b2c4-5b73717ba9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5b2b34-41eb-4811-a091-033fefd703e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5b2b34-41eb-4811-a091-033fefd703e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3358f8ef-f520-44e4-9892-09db9757a86f', 'volume_name': 'volume-3358f8ef-f520-44e4-9892-09db9757a86f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac367db1-f6d7-4d3b-845e-5853d3a077b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac367db1-f6d7-4d3b-845e-5853d3a077b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e77b0b0-8da7-40d9-bb13-703e1e9f81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Volume 3358f8ef-f520-44e4-9892-09db9757a86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3358f8ef-f520-44e4-9892-09db9757a86f', 'volume_size': 1} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-816385961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3358f8ef-f520-44e4-9892-09db9757a86f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c14ae070ab1b4dba9f63c45861d074d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:13Z,use_quota=True,user_id='f0b2e5f4eefc496192c5a804a6da70d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Creating volume 3358f8ef-f520-44e4-9892-09db9757a86f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:13 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd5c30-5b2d-45aa-bad7-5abe4a6e64a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf4ee66-f5a5-4fd8-8cce-1b99f187881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:13 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f 1073741824 Jul 17 05:37:13 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Volume volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb (bc8a456d-4b46-4fd5-990b-ac1701764bbb): created successfully Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf4ee66-f5a5-4fd8-8cce-1b99f187881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (3d8ed942-2b14-477f-94be-b2f80a10cec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:13 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5a0d54bc-94f1-4062-811c-07c53cac416a" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4dee989e-cbae-4c87-ad86-95f2577f928e tempest-ProjectReaderTests-356144502 None] Created volume successfully. Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-5a0d54bc-94f1-4062-811c-07c53cac416a" released by "delete_volume" :: held 0.996s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Created reservations ['2df69f6c-a6ee-4e69-8a9b-38d1e9db76c8', '168d11d6-d7dd-4de5-af2d-2524d017f3e1', 'b4311c5e-c594-4713-879f-1cce912f476e', '601f7ffc-9858-4870-930b-03f6c3475b38'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:13 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:13 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:14 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:14 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f 1073741824" returned: 0 in 0.516s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Deleted volume successfully. Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f76322b4-4ff9-4a9a-af15-dd67f5557645 tempest-VolumesGetTest-1031853365 None] Lock "cinder-5a0d54bc-94f1-4062-811c-07c53cac416a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:14 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f Jul 17 05:37:14 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:14 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e77b0b0-8da7-40d9-bb13-703e1e9f81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3358f8ef-f520-44e4-9892-09db9757a86f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b4b1b3-6df9-45dc-9852-113392bf332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Volume volume-3358f8ef-f520-44e4-9892-09db9757a86f (3358f8ef-f520-44e4-9892-09db9757a86f): created successfully Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b4b1b3-6df9-45dc-9852-113392bf332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Flow 'volume_create_manager' (4d55a774-1fcf-4132-bc97-a75af8a8fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e18910e1-ad38-41d7-b479-b970dfcbddb2 tempest-VolumesListTestJSON-727217417 None] Created volume successfully. Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-bc8a456d-4b46-4fd5-990b-ac1701764bbb-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Lock "cinder-bc8a456d-4b46-4fd5-990b-ac1701764bbb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-quobyte-bc8a456d-4b46-4fd5-990b-ac1701764bbb" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-bc8a456d-4b46-4fd5-990b-ac1701764bbb" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[17275e6f-2638-46f0-a2ba-2f8ccfa9fe04]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:14 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb Jul 17 05:37:14 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-89ca3ae8-db46-4dbf-a784-6d109004cd0f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Lock "cinder-89ca3ae8-db46-4dbf-a784-6d109004cd0f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-89ca3ae8-db46-4dbf-a784-6d109004cd0f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-89ca3ae8-db46-4dbf-a784-6d109004cd0f" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:14 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27455f-9a45-4d3e-bd57-eb74bf9c0be0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:15 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb Jul 17 05:37:15 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:15 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f Jul 17 05:37:15 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:15 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bc8a456d-4b46-4fd5-990b-ac1701764bbb" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-bc8a456d-4b46-4fd5-990b-ac1701764bbb" released by "delete_volume" :: held 0.797s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Created reservations ['b73c71e8-4248-4884-978e-102603314207', 'ee91e538-98d4-4cec-989e-e34858e8a7a2', '4149116e-bafc-42af-990c-c5bad45f3ea0', '73b73001-1ed5-4f3f-92c9-07b712e5cdc6'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:15 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f" returned: 0 in 0.451s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:15 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f Jul 17 05:37:15 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:15 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:15 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:15 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-89ca3ae8-db46-4dbf-a784-6d109004cd0f" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-89ca3ae8-db46-4dbf-a784-6d109004cd0f" released by "delete_volume" :: held 0.862s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:15 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.360s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Deleted volume successfully. Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91b4957-0286-4295-ac28-0d32107d5306 tempest-ProjectReaderTests-356144502 None] Lock "cinder-bc8a456d-4b46-4fd5-990b-ac1701764bbb-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Created reservations ['050c038c-fab0-4b80-8443-630b666ceafc', '211b49c5-536c-4253-b3f8-9f1d5288b2b0', '78991ec6-986b-4f13-97ff-f996d89ae316', '307f607c-910f-4846-b755-649cfb5efabb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:16 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:16 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:16 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (fb579f60-37ae-42ab-b0dd-86ceaf77d0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84701591-848e-4a1e-8710-6e1aef8cf642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Deleted volume successfully. Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84701591-848e-4a1e-8710-6e1aef8cf642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584619889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca54251-1939-41b4-84f4-bf99c7c8b3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:16Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e13cd9d-73cc-4672-a993-8957e2d2f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e13cd9d-73cc-4672-a993-8957e2d2f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82380ff4-5cae-4bbf-a579-8b0fd7cdc7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82380ff4-5cae-4bbf-a579-8b0fd7cdc7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca54251-1939-41b4-84f4-bf99c7c8b3fb', 'volume_name': 'volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878bb2da-d90e-404b-b7fc-85c42c89b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878bb2da-d90e-404b-b7fc-85c42c89b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294aa622-929f-4cf2-ad96-1fb1ec8e5ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Volume 6ca54251-1939-41b4-84f4-bf99c7c8b3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb', 'volume_size': 1} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584619889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca54251-1939-41b4-84f4-bf99c7c8b3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:16Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Creating volume 6ca54251-1939-41b4-84f4-bf99c7c8b3fb {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:16 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:16 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb 1073741824 Jul 17 05:37:16 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cc1ddf6-4c89-488e-ba12-59191c099dc3 tempest-VolumesGetTest-1031853365 None] Lock "cinder-89ca3ae8-db46-4dbf-a784-6d109004cd0f-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Flow 'volume_create_manager' (0b9e54bd-d68a-4d2d-a160-41274e66797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca234df-abd0-49f9-baa2-f48ee213c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca234df-abd0-49f9-baa2-f48ee213c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1261433959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8886d3dd-d46b-4cf4-95e7-236ae9024606,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c14ae070ab1b4dba9f63c45861d074d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:17Z,use_quota=True,user_id='f0b2e5f4eefc496192c5a804a6da70d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c3fde9-eb6a-430c-89b8-d9e2e18954ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c3fde9-eb6a-430c-89b8-d9e2e18954ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce887e4-8238-4d6f-8cb1-2e49206bf94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce887e4-8238-4d6f-8cb1-2e49206bf94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8886d3dd-d46b-4cf4-95e7-236ae9024606', 'volume_name': 'volume-8886d3dd-d46b-4cf4-95e7-236ae9024606', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b19cbb-5d6e-4b6a-a45d-8fffd2306597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b19cbb-5d6e-4b6a-a45d-8fffd2306597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ed4ed8-ab9c-404f-bff0-cf896043981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Volume 8886d3dd-d46b-4cf4-95e7-236ae9024606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8886d3dd-d46b-4cf4-95e7-236ae9024606', 'volume_size': 1} Jul 17 05:37:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:17 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (0763d0af-6cd7-451f-8d6a-7a89acfff7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d7f9bc-d724-478c-bf5f-7bb2fbb9ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb 1073741824" returned: 0 in 0.672s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d7f9bc-d724-478c-bf5f-7bb2fbb9ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2051886921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af15a30a-9766-4b98-b183-e3ca4dc048f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:17Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7cb71-9a02-4170-b37b-56d5d188d071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7cb71-9a02-4170-b37b-56d5d188d071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5c45e6-c94a-4e1e-abbf-0e0e47e7e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:17 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb Jul 17 05:37:17 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:17 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1261433959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8886d3dd-d46b-4cf4-95e7-236ae9024606,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c14ae070ab1b4dba9f63c45861d074d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:17Z,use_quota=True,user_id='f0b2e5f4eefc496192c5a804a6da70d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Creating volume 8886d3dd-d46b-4cf4-95e7-236ae9024606 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:17 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294aa622-929f-4cf2-ad96-1fb1ec8e5ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:17 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 1073741824 Jul 17 05:37:17 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d281edb-28a7-4726-a5d4-5077dbbf867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5c45e6-c94a-4e1e-abbf-0e0e47e7e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af15a30a-9766-4b98-b183-e3ca4dc048f0', 'volume_name': 'volume-af15a30a-9766-4b98-b183-e3ca4dc048f0', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fdfde8-a72c-47b3-b695-0c422219ed54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fdfde8-a72c-47b3-b695-0c422219ed54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb167b8-f80e-4810-a18b-c476ae4e80c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Volume af15a30a-9766-4b98-b183-e3ca4dc048f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af15a30a-9766-4b98-b183-e3ca4dc048f0', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Trying to clone af15a30a-9766-4b98-b183-e3ca4dc048f0 from image 574080f6-40fa-4386-bd5c-892273b66d56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:37:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Volume volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb (6ca54251-1939-41b4-84f4-bf99c7c8b3fb): created successfully Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d281edb-28a7-4726-a5d4-5077dbbf867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (fb579f60-37ae-42ab-b0dd-86ceaf77d0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3b7ac766-cd33-47da-9f99-b698e7a86864 tempest-ProjectReaderTests-356144502 None] Created volume successfully. Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:37:18 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Image download 20.69 MB at 20.69 MB/s Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4765459-927d-4a3f-b60f-228635a0b2c1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:18 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 1073741824" returned: 0 in 0.564s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:18 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 Jul 17 05:37:18 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:18 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD Jul 17 05:37:18 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-6ca54251-1939-41b4-84f4-bf99c7c8b3fb-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Lock "cinder-6ca54251-1939-41b4-84f4-bf99c7c8b3fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-quobyte-6ca54251-1939-41b4-84f4-bf99c7c8b3fb" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-6ca54251-1939-41b4-84f4-bf99c7c8b3fb" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:18 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606" returned: 0 in 0.356s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:18 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebf41e0-0e17-4eec-b883-d7fd7b894897]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ed4ed8-ab9c-404f-bff0-cf896043981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8886d3dd-d46b-4cf4-95e7-236ae9024606', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdbfc5c-eb0b-4035-9e72-ebaa07578e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 is fetched for user 830b8e100d2040d18cbb982baa277d13. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:37:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Volume volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 (8886d3dd-d46b-4cf4-95e7-236ae9024606): created successfully Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdbfc5c-eb0b-4035-9e72-ebaa07578e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Flow 'volume_create_manager' (0b9e54bd-d68a-4d2d-a160-41274e66797d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-818dc26c-d40d-4311-b207-23b0386cd73d tempest-VolumesListTestJSON-727217417 None] Created volume successfully. Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbd50ad-c6fd-470e-9dc0-5b12d1e21efd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:18 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb Jul 17 05:37:18 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:18 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD Jul 17 05:37:18 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:19 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb" returned: 0 in 0.484s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:19 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2051886921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af15a30a-9766-4b98-b183-e3ca4dc048f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:17Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Creating volume af15a30a-9766-4b98-b183-e3ca4dc048f0 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:19 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb Jul 17 05:37:19 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:19 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 1073741824 Jul 17 05:37:19 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:19 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6ca54251-1939-41b4-84f4-bf99c7c8b3fb" returned: 0 in 0.283s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-6ca54251-1939-41b4-84f4-bf99c7c8b3fb" released by "delete_volume" :: held 0.834s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Created reservations ['d2c69979-9a42-43cf-b6a5-d4e77a35d146', '9c7ceac2-dc78-415d-abfd-e0e0a8015344', '30e2c181-85f2-41f0-a777-b68cf449968f', '44f77b24-5ac5-485d-903b-c6718ba91620'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:19 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:19 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:19 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 1073741824" returned: 0 in 0.682s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:19 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 Jul 17 05:37:19 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:19 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.405s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:19 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Deleted volume successfully. Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bd6b8e23-2723-4139-a947-90db19fa2cf5 tempest-ProjectReaderTests-356144502 None] Lock "cinder-6ca54251-1939-41b4-84f4-bf99c7c8b3fb-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:20 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Attempting download of 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume af15a30a-9766-4b98-b183-e3ca4dc048f0. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76e044-4577-4e1a-87b2-64e3b4346659]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_v7_00w1i {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (3ee3e148-8531-4361-ade2-177ed27e6dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e09a6fe-8db0-45fe-8418-c0c9fb204345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e09a6fe-8db0-45fe-8418-c0c9fb204345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886928057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a49abc-aeed-4699-a6c9-a3635dc7d132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:20Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db802bde-c45d-402f-8cbc-571152a0d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db802bde-c45d-402f-8cbc-571152a0d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89e86eb-d563-46c8-b6aa-cbfd8a4dd2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89e86eb-d563-46c8-b6aa-cbfd8a4dd2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a49abc-aeed-4699-a6c9-a3635dc7d132', 'volume_name': 'volume-19a49abc-aeed-4699-a6c9-a3635dc7d132', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef40ccac-9aea-4836-aa06-40f4047ca03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef40ccac-9aea-4836-aa06-40f4047ca03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42acdeff-f4c4-4c37-93f3-3ec24b42f346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Volume 19a49abc-aeed-4699-a6c9-a3635dc7d132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a49abc-aeed-4699-a6c9-a3635dc7d132', 'volume_size': 1} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886928057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a49abc-aeed-4699-a6c9-a3635dc7d132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:20Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Creating volume 19a49abc-aeed-4699-a6c9-a3635dc7d132 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:20 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_v7_00w1i Jul 17 05:37:20 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:20 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 1073741824 Jul 17 05:37:20 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:20 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_v7_00w1i" returned: 0 in 0.426s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_v7_00w1i {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:20 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_v7_00w1i Jul 17 05:37:20 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:21 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 1073741824" returned: 0 in 0.567s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:21 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 Jul 17 05:37:21 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_v7_00w1i" returned: 1 in 0.457s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_v7_00w1i' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:37:21 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ddf15e-ed19-47fa-8575-0b99ed667b61]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:21 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:21 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD Jul 17 05:37:21 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42acdeff-f4c4-4c37-93f3-3ec24b42f346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a49abc-aeed-4699-a6c9-a3635dc7d132', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339d951d-98bb-4ab5-a54f-b931e0d06d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Volume volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 (19a49abc-aeed-4699-a6c9-a3635dc7d132): created successfully Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339d951d-98bb-4ab5-a54f-b931e0d06d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (3ee3e148-8531-4361-ade2-177ed27e6dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5e657c2c-8f3b-44dc-97c9-095eff1c62cb tempest-ProjectReaderTests-356144502 None] Created volume successfully. Jul 17 05:37:21 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] 574080f6-40fa-4386-bd5c-892273b66d56 was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:37:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:21 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 Jul 17 05:37:21 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Acquiring lock "cinder-8886d3dd-d46b-4cf4-95e7-236ae9024606-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Lock "cinder-8886d3dd-d46b-4cf4-95e7-236ae9024606-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Acquiring lock "cinder-quobyte-8886d3dd-d46b-4cf4-95e7-236ae9024606" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Lock "cinder-quobyte-8886d3dd-d46b-4cf4-95e7-236ae9024606" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85a186b-ce6b-475c-8db1-650f443a1a0c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:22 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 Jul 17 05:37:22 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-19a49abc-aeed-4699-a6c9-a3635dc7d132-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Lock "cinder-19a49abc-aeed-4699-a6c9-a3635dc7d132-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-quobyte-19a49abc-aeed-4699-a6c9-a3635dc7d132" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-19a49abc-aeed-4699-a6c9-a3635dc7d132" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:22 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606" returned: 0 in 0.540s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[983dc7f2-1906-4c2e-9e99-5a2930097988]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:22 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606 Jul 17 05:37:22 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:22 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 Jul 17 05:37:22 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:23 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8886d3dd-d46b-4cf4-95e7-236ae9024606" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Lock "cinder-quobyte-8886d3dd-d46b-4cf4-95e7-236ae9024606" released by "delete_volume" :: held 0.947s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Created reservations ['df37bf37-52e3-4e99-804f-f7fb30bb0bf8', 'fccf8d69-d509-4379-83b3-6f5ab7974dae', 'f5e611db-a386-4b0d-9ba6-c1bb09a6b6aa', '87c56037-419c-4da3-9a94-9338641a08d6'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:23 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132" returned: 0 in 0.532s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:23 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132 Jul 17 05:37:23 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:23 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:23 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:23 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-19a49abc-aeed-4699-a6c9-a3635dc7d132" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-19a49abc-aeed-4699-a6c9-a3635dc7d132" released by "delete_volume" :: held 0.949s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:23 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Deleted volume successfully. Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d774f6-6ee9-45b0-981d-528926b7593b tempest-VolumesListTestJSON-727217417 None] Lock "cinder-8886d3dd-d46b-4cf4-95e7-236ae9024606-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Created reservations ['a6b238e6-44f8-4845-8809-9ba63a283051', 'efabeea7-f56b-4db6-bf57-21953a532492', '7d166947-025a-4556-ae51-7106035a864f', 'f8a8bde0-312d-407c-8978-85802075c40e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:23 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:23 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:23 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0" returned: 0 in 2.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_qs727uoddevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:37:23 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Converted 112.00 MB image at 49.87 MB/s Jul 17 05:37:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:24 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 1G Jul 17 05:37:24 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:24 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Deleted volume successfully. Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a12b1ed2-5bbe-4684-a1b8-5572cfc5b04f tempest-ProjectReaderTests-356144502 None] Lock "cinder-19a49abc-aeed-4699-a6c9-a3635dc7d132-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Acquiring lock "cinder-3358f8ef-f520-44e4-9892-09db9757a86f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Lock "cinder-3358f8ef-f520-44e4-9892-09db9757a86f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:24 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 1G" returned: 0 in 0.454s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Downloaded image 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume af15a30a-9766-4b98-b183-e3ca4dc048f0 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 for user 830b8e100d2040d18cbb982baa277d13 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Marking volume af15a30a-9766-4b98-b183-e3ca4dc048f0 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Acquiring lock "cinder-quobyte-3358f8ef-f520-44e4-9892-09db9757a86f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Copying metadata from image 574080f6-40fa-4386-bd5c-892273b66d56 to af15a30a-9766-4b98-b183-e3ca4dc048f0. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Creating volume glance metadata for volume af15a30a-9766-4b98-b183-e3ca4dc048f0 backed by image 574080f6-40fa-4386-bd5c-892273b66d56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Lock "cinder-quobyte-3358f8ef-f520-44e4-9892-09db9757a86f" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[026f30d5-039a-4183-b908-ab3a4721f29b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb167b8-f80e-4810-a18b-c476ae4e80c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af15a30a-9766-4b98-b183-e3ca4dc048f0', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117053df-7fdf-463c-99e3-22e49afb761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Volume volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 (af15a30a-9766-4b98-b183-e3ca4dc048f0): created successfully Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117053df-7fdf-463c-99e3-22e49afb761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (0763d0af-6cd7-451f-8d6a-7a89acfff7a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8ab8c6e8-bd82-4ef3-9211-5a2a8f027ed2 tempest-VolumesGetTest-1031853365 None] Created volume successfully. Jul 17 05:37:24 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f Jul 17 05:37:24 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:24 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:24 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f Jul 17 05:37:24 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:25 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3358f8ef-f520-44e4-9892-09db9757a86f" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Lock "cinder-quobyte-3358f8ef-f520-44e4-9892-09db9757a86f" released by "delete_volume" :: held 0.895s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Created reservations ['e5e8781b-c814-4455-a3c2-f9e87f5d7cd4', '0c56bac0-4355-4994-9b5d-b790386e3c4b', 'be1020e0-47b4-41fd-80e9-d4b5fc29579c', '205a10fe-a85b-4622-ba86-b1bd00061b4d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (99009f31-565d-408a-9c62-46afe6b982dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c3d032-ac0a-443a-a152-2d632aa25728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c3d032-ac0a-443a-a152-2d632aa25728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059881221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:25Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51309b3-9da7-4fc7-b234-d135a81bd776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51309b3-9da7-4fc7-b234-d135a81bd776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1604ff1c-ab75-41ef-ad53-129c4c21487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1604ff1c-ab75-41ef-ad53-129c4c21487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84ed5dd-ec4f-419d-ae79-f1169ec1f0a7', 'volume_name': 'volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9086a570-82db-43dd-9e2c-d00357ad90bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9086a570-82db-43dd-9e2c-d00357ad90bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df1790-03a6-4c37-9c99-b77798f3b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Volume d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7', 'volume_size': 1} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059881221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad6e19d7a74767878b492ede7b3fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:25Z,use_quota=True,user_id='38a935ada0a84d5c9efb4de6089f9c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Creating volume d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:25 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:25 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 1073741824 Jul 17 05:37:25 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:25 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:25 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (8d5253bf-7a98-4862-9d2d-08b8f2fdafbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6fdfde-d487-4c99-a8d2-f5cb75fc9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6fdfde-d487-4c99-a8d2-f5cb75fc9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2087532647',display_name='tempest-VolumesGetTest-Volume-537123222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a17969-05b0-4a9f-b0af-7182ea11cde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:26Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c4a99-22e8-43c0-8dd0-da0f1f4ab8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c4a99-22e8-43c0-8dd0-da0f1f4ab8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de73d76a-b8c5-4cdd-858a-510302813728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de73d76a-b8c5-4cdd-858a-510302813728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a17969-05b0-4a9f-b0af-7182ea11cde2', 'volume_name': 'volume-82a17969-05b0-4a9f-b0af-7182ea11cde2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c449b7-e269-4d5b-827d-cc7729ecff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c449b7-e269-4d5b-827d-cc7729ecff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f66ec10-b765-4967-acd6-dda30ee02f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Volume 82a17969-05b0-4a9f-b0af-7182ea11cde2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a17969-05b0-4a9f-b0af-7182ea11cde2', 'volume_size': 1} Jul 17 05:37:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:26 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Deleted volume successfully. Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5965300-144a-4206-9715-a7b7d79b5b8a tempest-VolumesListTestJSON-727217417 None] Lock "cinder-3358f8ef-f520-44e4-9892-09db9757a86f-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:26 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 1073741824" returned: 0 in 0.519s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:26 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 Jul 17 05:37:26 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:26 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2087532647',display_name='tempest-VolumesGetTest-Volume-537123222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a17969-05b0-4a9f-b0af-7182ea11cde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd56675fbd947d88fca701a39e222a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:26Z,use_quota=True,user_id='830b8e100d2040d18cbb982baa277d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Creating volume 82a17969-05b0-4a9f-b0af-7182ea11cde2 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:26 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df1790-03a6-4c37-9c99-b77798f3b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:26 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 1073741824 Jul 17 05:37:26 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6973a40-aa41-4381-aa4f-4c909042e7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:26 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Volume volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 (d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7): created successfully Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6973a40-aa41-4381-aa4f-4c909042e7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Flow 'volume_create_manager' (99009f31-565d-408a-9c62-46afe6b982dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-055c8987-cfea-4af2-9bab-ce2aebeb555c tempest-ProjectReaderTests-356144502 None] Created volume successfully. Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Acquiring lock "cinder-a328f373-8439-479f-bf2a-1e3b79b20354-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Lock "cinder-a328f373-8439-479f-bf2a-1e3b79b20354-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Acquiring lock "cinder-quobyte-a328f373-8439-479f-bf2a-1e3b79b20354" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Lock "cinder-quobyte-a328f373-8439-479f-bf2a-1e3b79b20354" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[09243cff-4569-4b49-ba16-21220eb4f8a6]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:26 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 1073741824" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:26 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 Jul 17 05:37:26 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:27 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 Jul 17 05:37:27 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:27 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:27 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f66ec10-b765-4967-acd6-dda30ee02f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a17969-05b0-4a9f-b0af-7182ea11cde2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3d2bad-8501-44ea-8aaa-905350c9412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Flow 'volume_create_manager' (4477fc46-184d-4ae2-8d58-1c759a3f0104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98db4854-92df-4660-916f-4a736adbc278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354" returned: 0 in 0.482s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Volume volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 (82a17969-05b0-4a9f-b0af-7182ea11cde2): created successfully Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3d2bad-8501-44ea-8aaa-905350c9412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:27 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354 Jul 17 05:37:27 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Flow 'volume_create_manager' (8d5253bf-7a98-4862-9d2d-08b8f2fdafbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98db4854-92df-4660-916f-4a736adbc278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-510895483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150102e3-34ab-42dc-a81c-c5fc0014442e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7486439eb520474a828b257d6257088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:27Z,use_quota=True,user_id='1372092e7bd84c75baa55efe65e37d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd5ad32-4cae-42de-97c3-4280f14e8d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd5ad32-4cae-42de-97c3-4280f14e8d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510dec65-c25c-4ff0-9c8e-72f445737995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510dec65-c25c-4ff0-9c8e-72f445737995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150102e3-34ab-42dc-a81c-c5fc0014442e', 'volume_name': 'volume-150102e3-34ab-42dc-a81c-c5fc0014442e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d227b051-d2db-4024-83dc-c6041a277a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d227b051-d2db-4024-83dc-c6041a277a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0526985-4780-4c60-8753-937feeaba24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Volume 150102e3-34ab-42dc-a81c-c5fc0014442e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150102e3-34ab-42dc-a81c-c5fc0014442e', 'volume_size': 1} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-510895483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150102e3-34ab-42dc-a81c-c5fc0014442e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7486439eb520474a828b257d6257088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:27Z,use_quota=True,user_id='1372092e7bd84c75baa55efe65e37d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Creating volume 150102e3-34ab-42dc-a81c-c5fc0014442e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5e2de366-78bc-41dd-a1c0-55e7334d65c2 tempest-VolumesGetTest-1031853365 None] Created volume successfully. Jul 17 05:37:27 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e 1073741824 Jul 17 05:37:27 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Lock "cinder-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:27 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a328f373-8439-479f-bf2a-1e3b79b20354" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Lock "cinder-quobyte-a328f373-8439-479f-bf2a-1e3b79b20354" released by "delete_volume" :: held 0.806s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Acquiring lock "cinder-quobyte-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[29119678-f243-4ee7-bd94-4c43b267d849]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Created reservations ['a039ebe0-54ce-4421-a25c-8e9df935cef1', 'd5293de7-2b30-4639-897a-d818ee62b65a', 'a54402aa-4212-4e1e-8b6d-975134c1a87d', 'ad5e3600-36a3-4c50-8539-d938190c758e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:27 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 Jul 17 05:37:27 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:27 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:27 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-82a17969-05b0-4a9f-b0af-7182ea11cde2-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:28 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Lock "cinder-82a17969-05b0-4a9f-b0af-7182ea11cde2-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e 1073741824" returned: 0 in 0.705s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-82a17969-05b0-4a9f-b0af-7182ea11cde2" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:28 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e Jul 17 05:37:28 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:28 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:28 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-82a17969-05b0-4a9f-b0af-7182ea11cde2" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Deleted volume successfully. Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7" returned: 0 in 0.591s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd375168-2e07-4d2e-9fbe-6353d1639b87]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:28 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7 Jul 17 05:37:28 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9fc81eab-ebbf-437c-a080-f27d4946be8f tempest-VolumesListTestJSON-727217417 None] Lock "cinder-a328f373-8439-479f-bf2a-1e3b79b20354-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:28 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 Jul 17 05:37:28 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:28 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e" returned: 0 in 0.328s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:28 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Lock "cinder-quobyte-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7" released by "delete_volume" :: held 0.936s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:28 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:28 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2 Jul 17 05:37:28 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0526985-4780-4c60-8753-937feeaba24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150102e3-34ab-42dc-a81c-c5fc0014442e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730e404b-1d75-4ff1-9b64-ac55180b932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Created reservations ['1f9c66c3-9670-43d0-8136-aef064177a20', '257db95a-1c52-452d-b05c-91e6d0619d51', '160ed53f-30fc-4461-a863-9ec87c3c45e6', '22a40493-acf2-4698-8a7a-48ab31d529f6'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Volume volume-150102e3-34ab-42dc-a81c-c5fc0014442e (150102e3-34ab-42dc-a81c-c5fc0014442e): created successfully Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730e404b-1d75-4ff1-9b64-ac55180b932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Flow 'volume_create_manager' (4477fc46-184d-4ae2-8d58-1c759a3f0104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3eac2b48-9a10-4371-b2f6-b2a0964ddd7f tempest-VolumesListAdminTestJSON-448482687 None] Created volume successfully. Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:28 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:28 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:28 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a17969-05b0-4a9f-b0af-7182ea11cde2" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-82a17969-05b0-4a9f-b0af-7182ea11cde2" released by "delete_volume" :: held 0.722s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Created reservations ['fdc53f55-0dcf-4cd8-8d5d-2da2d81f8968', 'ba808ca5-97c0-4bf9-abf4-015ad7f54dd4', '06100745-21fd-4a5e-bc31-db947b2be3ce', '34bcc156-c4d7-495e-bffa-0aaf9c55c392'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:29 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Deleted volume successfully. Jul 17 05:37:29 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:29 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2aa00181-f9c7-4277-a73b-d9cf5c1cef38 tempest-ProjectReaderTests-356144502 None] Lock "cinder-d84ed5dd-ec4f-419d-ae79-f1169ec1f0a7-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-af15a30a-9766-4b98-b183-e3ca4dc048f0-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:29 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.316s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Lock "cinder-af15a30a-9766-4b98-b183-e3ca4dc048f0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Deleted volume successfully. Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ca87d2b5-2735-4c11-9814-49c34fa5295a tempest-VolumesGetTest-1031853365 None] Lock "cinder-82a17969-05b0-4a9f-b0af-7182ea11cde2-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Acquiring lock "cinder-quobyte-af15a30a-9766-4b98-b183-e3ca4dc048f0" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-af15a30a-9766-4b98-b183-e3ca4dc048f0" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e422f-2c98-47bb-ad4b-34e427508c14]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:29 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 Jul 17 05:37:29 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Flow 'volume_create_manager' (d073aad7-302a-4045-84f8-1f89f82554d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196fe68c-fbc9-4524-b6df-278c3e6cba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:30 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196fe68c-fbc9-4524-b6df-278c3e6cba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1766347129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3245dd-e7cd-45f7-ac7e-6199bf36e8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7486439eb520474a828b257d6257088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:30Z,use_quota=True,user_id='1372092e7bd84c75baa55efe65e37d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8d4f61-c5a0-4f25-a109-507b845973af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8d4f61-c5a0-4f25-a109-507b845973af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2ceefe-8b1a-4d87-a85b-6bb1d1c4f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:30 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0 Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2ceefe-8b1a-4d87-a85b-6bb1d1c4f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3245dd-e7cd-45f7-ac7e-6199bf36e8fa', 'volume_name': 'volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:30 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee633c58-3e13-4882-ace8-01246294c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee633c58-3e13-4882-ace8-01246294c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d09f59-ed89-4a0d-a0e7-f116d81b736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Volume da3245dd-e7cd-45f7-ac7e-6199bf36e8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa', 'volume_size': 1} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1766347129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3245dd-e7cd-45f7-ac7e-6199bf36e8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7486439eb520474a828b257d6257088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:30Z,use_quota=True,user_id='1372092e7bd84c75baa55efe65e37d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Creating volume da3245dd-e7cd-45f7-ac7e-6199bf36e8fa {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:30 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:30 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa 1073741824 Jul 17 05:37:30 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:30 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-af15a30a-9766-4b98-b183-e3ca4dc048f0" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Lock "cinder-quobyte-af15a30a-9766-4b98-b183-e3ca4dc048f0" released by "delete_volume" :: held 0.923s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Created reservations ['4dfda632-772a-41bc-8a18-1857e371db08', '7b17a461-0ebe-41f0-923e-606939b0b7bf', '88fa69a0-0ae2-4575-ae78-1da9a9095ab3', '53a04f9d-8716-4747-b191-31825211ea5e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:30 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:30 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:30 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa 1073741824" returned: 0 in 0.592s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:30 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa Jul 17 05:37:30 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:30 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:30 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Deleted volume successfully. Jul 17 05:37:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec33e58e-08da-4cf7-8751-cca74df00ab5 tempest-VolumesGetTest-1031853365 None] Lock "cinder-af15a30a-9766-4b98-b183-e3ca4dc048f0-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:31 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d09f59-ed89-4a0d-a0e7-f116d81b736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ba3e0f-9db2-4e7a-8654-226513b4d8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Volume volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa (da3245dd-e7cd-45f7-ac7e-6199bf36e8fa): created successfully Jul 17 05:37:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ba3e0f-9db2-4e7a-8654-226513b4d8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Flow 'volume_create_manager' (d073aad7-302a-4045-84f8-1f89f82554d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a30ef836-71fd-416b-9db8-18ae39f1e82d tempest-VolumesListAdminTestJSON-448482687 None] Created volume successfully. Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Flow 'volume_create_manager' (238c822c-8d5d-4708-a39d-cfe6c7999ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f848c973-b960-43cf-b911-b8acfb8248e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f848c973-b960-43cf-b911-b8acfb8248e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1976491316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d32a43-6041-4913-872a-23a6caedcbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f931aae5e31e4e46875cb9f678fc3566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:32Z,use_quota=True,user_id='0313d2f6a7af40f1b29ad2a542b4e58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75d2ea9-2107-4183-b292-147476e3264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75d2ea9-2107-4183-b292-147476e3264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332bb718-3e06-4c4d-88fe-ee8439b1cbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332bb718-3e06-4c4d-88fe-ee8439b1cbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d32a43-6041-4913-872a-23a6caedcbb8', 'volume_name': 'volume-f3d32a43-6041-4913-872a-23a6caedcbb8', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca717e8-76ed-42ff-8a8b-aa57a49ac26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca717e8-76ed-42ff-8a8b-aa57a49ac26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce162085-dd10-42a0-93ea-c5ca34ee4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Volume f3d32a43-6041-4913-872a-23a6caedcbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d32a43-6041-4913-872a-23a6caedcbb8', 'volume_size': 2} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1976491316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d32a43-6041-4913-872a-23a6caedcbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f931aae5e31e4e46875cb9f678fc3566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:32Z,use_quota=True,user_id='0313d2f6a7af40f1b29ad2a542b4e58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Creating volume f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:32 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 2147483648 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:32 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 2147483648 Jul 17 05:37:32 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:32 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 2147483648" returned: 0 in 0.580s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:32 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 Jul 17 05:37:32 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Flow 'volume_create_manager' (71abfbe6-3076-46e1-bd13-be65d8eac6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a12f153-a5a3-4a54-bb67-e02132ce546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a12f153-a5a3-4a54-bb67-e02132ce546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1568864201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afb55d6-d9ce-4958-9683-9f4db3ae7889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7486439eb520474a828b257d6257088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:33Z,use_quota=True,user_id='1372092e7bd84c75baa55efe65e37d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7603f8e-94f3-4b33-946e-9c9f1e242825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7603f8e-94f3-4b33-946e-9c9f1e242825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202c4a24-5fd4-437a-8ef3-80d5af011391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202c4a24-5fd4-437a-8ef3-80d5af011391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afb55d6-d9ce-4958-9683-9f4db3ae7889', 'volume_name': 'volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461fbb19-d216-429a-878e-4b7a2366b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461fbb19-d216-429a-878e-4b7a2366b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cde59ad-10bf-4251-8cf6-9603ce4215dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Volume 6afb55d6-d9ce-4958-9683-9f4db3ae7889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889', 'volume_size': 1} Jul 17 05:37:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:33 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1568864201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afb55d6-d9ce-4958-9683-9f4db3ae7889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7486439eb520474a828b257d6257088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:33Z,use_quota=True,user_id='1372092e7bd84c75baa55efe65e37d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Creating volume 6afb55d6-d9ce-4958-9683-9f4db3ae7889 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:33 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce162085-dd10-42a0-93ea-c5ca34ee4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d32a43-6041-4913-872a-23a6caedcbb8', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:33 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 1073741824 Jul 17 05:37:33 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7336c931-36ab-4f2c-ba03-b88ed4d03a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Volume volume-f3d32a43-6041-4913-872a-23a6caedcbb8 (f3d32a43-6041-4913-872a-23a6caedcbb8): created successfully Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7336c931-36ab-4f2c-ba03-b88ed4d03a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Flow 'volume_create_manager' (238c822c-8d5d-4708-a39d-cfe6c7999ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b94dea6a-3e35-47fb-8ab4-b4ece5a0b942 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Created volume successfully. Jul 17 05:37:33 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 1073741824" returned: 0 in 0.447s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:33 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 Jul 17 05:37:33 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:33 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889" returned: 0 in 0.278s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cde59ad-10bf-4251-8cf6-9603ce4215dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4096c299-943e-440c-a74a-598949302b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Volume volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 (6afb55d6-d9ce-4958-9683-9f4db3ae7889): created successfully Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4096c299-943e-440c-a74a-598949302b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Flow 'volume_create_manager' (71abfbe6-3076-46e1-bd13-be65d8eac6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-76cb31d3-a9e6-42ef-9b68-58260e504c84 tempest-VolumesListAdminTestJSON-448482687 None] Created volume successfully. Jul 17 05:37:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Creating offline snapshot 10dca1c1-c4c9-49be-bb46-fa98494f84a9 of volume f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:37:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[52577308-7fa1-49de-9289-d8a595ec2545]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:34 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 Jul 17 05:37:34 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:34 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8" returned: 0 in 0.399s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 2G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:34 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 2G Jul 17 05:37:34 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Flow 'volume_create_manager' (63e94236-827c-44f9-a8ff-24d60d053e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8b242e-d58f-4518-b360-6da9cd8a8bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 2G" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3d32a43-6041-4913-872a-23a6caedcbb8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:35 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3d32a43-6041-4913-872a-23a6caedcbb8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8b242e-d58f-4518-b360-6da9cd8a8bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-478203100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b87c7b-0332-4725-85f0-1452dd298e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22acfa1a74284d22b7078116ccd0f7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:35Z,use_quota=True,user_id='e35f23e593be4334a70aa03dfdffd786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704761e3-727c-4101-b37e-721aa600ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704761e3-727c-4101-b37e-721aa600ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfd8cef-fdb1-48c6-8615-cf2a968bce88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfd8cef-fdb1-48c6-8615-cf2a968bce88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b87c7b-0332-4725-85f0-1452dd298e68', 'volume_name': 'volume-96b87c7b-0332-4725-85f0-1452dd298e68', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bb0167-542f-4b4b-a2dc-e176287fa27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bb0167-542f-4b4b-a2dc-e176287fa27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab954ad-0b5e-4c7c-8240-865a6007e3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Volume 96b87c7b-0332-4725-85f0-1452dd298e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b87c7b-0332-4725-85f0-1452dd298e68', 'volume_size': 1} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:35 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3d32a43-6041-4913-872a-23a6caedcbb8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:35 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 is being set with open permissions: ugo+rw Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:35 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 Jul 17 05:37:35 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Flow 'volume_create_manager' (6b251804-f92e-4ade-9d6f-3ee5c78d89e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1318beb1-db76-4aac-a692-84700bb989e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1318beb1-db76-4aac-a692-84700bb989e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ffca3d-1296-4080-9249-1c6562b68470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9b59283de0422080630232c9cda7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:36Z,use_quota=True,user_id='ecd56b267863489899978446271a4f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446dcbdb-35ff-4f80-bfe3-c413d9179e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446dcbdb-35ff-4f80-bfe3-c413d9179e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b50b91d-dc7c-408a-b858-cf999ece0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b50b91d-dc7c-408a-b858-cf999ece0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ffca3d-1296-4080-9249-1c6562b68470', 'volume_name': 'volume-b8ffca3d-1296-4080-9249-1c6562b68470', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb5213b-43c0-4d36-a87a-599bf58bc708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb5213b-43c0-4d36-a87a-599bf58bc708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83fd779-3f24-4703-a84d-202516f3f32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Volume b8ffca3d-1296-4080-9249-1c6562b68470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ffca3d-1296-4080-9249-1c6562b68470', 'volume_size': 1} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:35 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.info Jul 17 05:37:35 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:36 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.info" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:36 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.info is being set with open permissions: ugo+rw Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:36 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.info Jul 17 05:37:36 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:36 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.info" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-478203100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b87c7b-0332-4725-85f0-1452dd298e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22acfa1a74284d22b7078116ccd0f7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:35Z,use_quota=True,user_id='e35f23e593be4334a70aa03dfdffd786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Creating volume 96b87c7b-0332-4725-85f0-1452dd298e68 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:36 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:36 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 1073741824 Jul 17 05:37:36 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a16f0edb-169a-449f-8ca9-755e1de6176f tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Create snapshot completed successfully Jul 17 05:37:36 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 1073741824" returned: 0 in 0.428s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:37 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 Jul 17 05:37:37 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:37 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ffca3d-1296-4080-9249-1c6562b68470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9b59283de0422080630232c9cda7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:36Z,use_quota=True,user_id='ecd56b267863489899978446271a4f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Creating volume b8ffca3d-1296-4080-9249-1c6562b68470 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:37 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab954ad-0b5e-4c7c-8240-865a6007e3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b87c7b-0332-4725-85f0-1452dd298e68', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:37 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 1073741824 Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4336fa-bdeb-4a14-8361-3b77af68706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:37 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Volume volume-96b87c7b-0332-4725-85f0-1452dd298e68 (96b87c7b-0332-4725-85f0-1452dd298e68): created successfully Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4336fa-bdeb-4a14-8361-3b77af68706c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Flow 'volume_create_manager' (63e94236-827c-44f9-a8ff-24d60d053e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-905aaba1-1ee4-4fd9-b3fe-4ceb34ae5f9e tempest-VolumesNegativeTest-471379366 None] Created volume successfully. Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "cinder-10dca1c1-c4c9-49be-bb46-fa98494f84a9-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-10dca1c1-c4c9-49be-bb46-fa98494f84a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "cinder-quobyte-f3d32a43-6041-4913-872a-23a6caedcbb8" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-quobyte-f3d32a43-6041-4913-872a-23a6caedcbb8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "cinder-quobyte-10dca1c1-c4c9-49be-bb46-fa98494f84a9" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-quobyte-10dca1c1-c4c9-49be-bb46-fa98494f84a9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Deleting offline snapshot 10dca1c1-c4c9-49be-bb46-fa98494f84a9 of volume f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] snapshot_file for this snap is: volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280a833-ba0c-43ff-8864-56a4765daec1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:37 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 Jul 17 05:37:37 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:37 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 1073741824" returned: 0 in 0.469s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:37 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 Jul 17 05:37:37 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:37 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3d32a43-6041-4913-872a-23a6caedcbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de0cafd-f745-4ea5-964d-e1aeaf87e53d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:38 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83fd779-3f24-4703-a84d-202516f3f32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ffca3d-1296-4080-9249-1c6562b68470', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da011b6a-bd3b-4e70-8bf8-29e6dcb1eb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Volume volume-b8ffca3d-1296-4080-9249-1c6562b68470 (b8ffca3d-1296-4080-9249-1c6562b68470): created successfully Jul 17 05:37:38 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 Jul 17 05:37:38 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da011b6a-bd3b-4e70-8bf8-29e6dcb1eb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Flow 'volume_create_manager' (6b251804-f92e-4ade-9d6f-3ee5c78d89e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a8bbc56b-4579-4c79-a4b1-78ecd2aaec92 tempest-VolumesListAdminTestJSON-1372666002 None] Created volume successfully. Jul 17 05:37:38 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:38 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 Jul 17 05:37:38 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:38 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9" returned: 0 in 0.338s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:38 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9 Jul 17 05:37:38 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Acquiring lock "cinder-b8ffca3d-1296-4080-9249-1c6562b68470-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Lock "cinder-b8ffca3d-1296-4080-9249-1c6562b68470-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:39 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8.10dca1c1-c4c9-49be-bb46-fa98494f84a9" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-quobyte-10dca1c1-c4c9-49be-bb46-fa98494f84a9" released by "_delete_snapshot" :: held 1.572s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Acquiring lock "cinder-quobyte-b8ffca3d-1296-4080-9249-1c6562b68470" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-quobyte-f3d32a43-6041-4913-872a-23a6caedcbb8" released by "delete_snapshot" :: held 1.600s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "cinder-6afb55d6-d9ce-4958-9683-9f4db3ae7889-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Lock "cinder-quobyte-b8ffca3d-1296-4080-9249-1c6562b68470" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-6afb55d6-d9ce-4958-9683-9f4db3ae7889-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600b9bd-a415-4ae3-b524-caad56f25fa4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "cinder-quobyte-6afb55d6-d9ce-4958-9683-9f4db3ae7889" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-quobyte-6afb55d6-d9ce-4958-9683-9f4db3ae7889" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Created reservations ['60887676-d813-4d15-bad5-da345ea3eae2', '89a4dbbc-1eb5-4d7f-8ec7-838bd3bcd71b', '5e5508c1-a7eb-4470-b3ef-ee302d2e4506', 'ea8a698a-f4cd-40d4-b4b6-2eb0d646ffd3'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0c439-6cee-43b2-aec1-51a6ee06e7a3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:39 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 Jul 17 05:37:39 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Delete snapshot completed successfully. Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0419a4ea-b413-4079-8fa4-a5d202d22de6 tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-10dca1c1-c4c9-49be-bb46-fa98494f84a9-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:39 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 Jul 17 05:37:39 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:39 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470" returned: 0 in 0.466s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:39 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470 Jul 17 05:37:39 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "cinder-f3d32a43-6041-4913-872a-23a6caedcbb8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-f3d32a43-6041-4913-872a-23a6caedcbb8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:39 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889" returned: 0 in 0.512s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:39 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889 Jul 17 05:37:39 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "cinder-quobyte-f3d32a43-6041-4913-872a-23a6caedcbb8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-quobyte-f3d32a43-6041-4913-872a-23a6caedcbb8" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[76573013-0e40-42c8-8daf-c77a2cfc84cf]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:40 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8ffca3d-1296-4080-9249-1c6562b68470" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Lock "cinder-quobyte-b8ffca3d-1296-4080-9249-1c6562b68470" released by "delete_volume" :: held 0.940s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:40 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 Jul 17 05:37:40 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Created reservations ['6de0c270-3fef-4d74-bd3f-c71ed953cdd7', '7ef8506c-7635-4b1d-a133-372630b32207', 'e83fe3d4-e558-495d-aeb5-92d6e4db8bc0', 'ec8329b4-560d-4dda-ab77-5bbb5cd4a622'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:40 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6afb55d6-d9ce-4958-9683-9f4db3ae7889" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-quobyte-6afb55d6-d9ce-4958-9683-9f4db3ae7889" released by "delete_volume" :: held 0.975s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Created reservations ['dfae5978-b431-4196-a2d0-5fb20b99c1c5', '6b8f0a36-17dc-49dd-b321-ac127988592c', 'a700f8a7-6092-4a55-a379-e17d4066e168', 'e80f298c-a63a-4d27-a8e4-3e5c12ee574b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:40 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:40 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:40 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:40 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:40 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8" returned: 0 in 0.576s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:40 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8 Jul 17 05:37:40 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:40 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Deleted volume successfully. Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-09781a4e-9aec-4dec-8f1c-1657d2809dcc tempest-VolumesListAdminTestJSON-1372666002 None] Lock "cinder-b8ffca3d-1296-4080-9249-1c6562b68470-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:40 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Deleted volume successfully. Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1f88b6e9-944c-4267-a10d-9854c546d71d tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-6afb55d6-d9ce-4958-9683-9f4db3ae7889-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:40 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f3d32a43-6041-4913-872a-23a6caedcbb8" returned: 0 in 0.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-quobyte-f3d32a43-6041-4913-872a-23a6caedcbb8" released by "delete_volume" :: held 1.013s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Created reservations ['d7c4189a-002c-4695-a0b7-c45fbd0b11a3', 'f492a037-3afb-4733-9469-452a69d7b182', 'aaf2bca3-2dd3-4239-9216-85d06d1816f5', '097001cf-a16a-436a-a613-bd27a5ec6bf3'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:41 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:41 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:41 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Deleted volume successfully. Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2eb9985-18b2-429d-9450-0a13c53438ad tempest-VolumesSnapshotNegativeTestJSON-1477258 None] Lock "cinder-f3d32a43-6041-4913-872a-23a6caedcbb8-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "cinder-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "cinder-quobyte-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-quobyte-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[511ed499-d026-4db9-adad-46bd845d6cd9]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:41 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa Jul 17 05:37:41 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:42 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:42 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa Jul 17 05:37:42 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:42 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-quobyte-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa" released by "delete_volume" :: held 0.827s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Created reservations ['bc85a6f3-57b5-46e6-b5bf-15f05c419305', '78916a81-edec-4e1b-9068-7b9af1709c43', 'f1174282-060f-4582-abd8-88f92d9a3ea6', '06558367-37c0-4d7c-9d31-c586fe34edbb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:42 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:42 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:43 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.295s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:43 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Deleted volume successfully. Jul 17 05:37:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b35b220-fcfd-4635-bd72-9135b8f864ca tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-da3245dd-e7cd-45f7-ac7e-6199bf36e8fa-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "cinder-150102e3-34ab-42dc-a81c-c5fc0014442e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-150102e3-34ab-42dc-a81c-c5fc0014442e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "cinder-quobyte-150102e3-34ab-42dc-a81c-c5fc0014442e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-quobyte-150102e3-34ab-42dc-a81c-c5fc0014442e" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2d824-cb9a-436a-abf9-4178e646cfa5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:44 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e Jul 17 05:37:44 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:44 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e" returned: 0 in 0.557s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:44 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e Jul 17 05:37:44 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:45 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-150102e3-34ab-42dc-a81c-c5fc0014442e" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-quobyte-150102e3-34ab-42dc-a81c-c5fc0014442e" released by "delete_volume" :: held 1.139s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Created reservations ['bb66bea5-82de-4639-bc14-a8cd376a8c51', '6e8e15b1-53ba-4985-9261-9cf9500cdcd3', 'abe249f2-ecd0-4d76-a0e0-f66775f14146', '92899872-d421-4e8b-9604-4982d2113f57'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:45 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:45 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:45 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.459s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Deleted volume successfully. Jul 17 05:37:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ce1c08a-796d-46cd-8ddf-c9cd8dcdb9bf tempest-VolumesListAdminTestJSON-448482687 None] Lock "cinder-150102e3-34ab-42dc-a81c-c5fc0014442e-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=186,cinder:UPDATE=265,cinder:DELETE=22,cinder:INSERT=69 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (4fdc15be-2a27-4d32-8714-6502b67bc703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2be7e0-f567-4a0f-a85b-4b896992779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2be7e0-f567-4a0f-a85b-4b896992779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018706216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f834b1-54d3-4852-98c2-0cda3b2272ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:47Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e04044-c8e5-42d4-8287-8ae786943677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e04044-c8e5-42d4-8287-8ae786943677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c29f4f-9d80-407b-9eff-4bae921cf8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c29f4f-9d80-407b-9eff-4bae921cf8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f834b1-54d3-4852-98c2-0cda3b2272ee', 'volume_name': 'volume-04f834b1-54d3-4852-98c2-0cda3b2272ee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5829a6-813e-495b-806a-b3a8ded9b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5829a6-813e-495b-806a-b3a8ded9b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12f33a1-d79a-439c-8a2b-28e8b29f9a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:46 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume 04f834b1-54d3-4852-98c2-0cda3b2272ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f834b1-54d3-4852-98c2-0cda3b2272ee', 'volume_size': 1} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018706216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f834b1-54d3-4852-98c2-0cda3b2272ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:47Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Creating volume 04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:46 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:46 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee 1073741824 Jul 17 05:37:46 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:47 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee 1073741824" returned: 0 in 0.688s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:47 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee Jul 17 05:37:47 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:47 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12f33a1-d79a-439c-8a2b-28e8b29f9a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f834b1-54d3-4852-98c2-0cda3b2272ee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d51560-c8a8-4eab-86ea-9e8af6609e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume volume-04f834b1-54d3-4852-98c2-0cda3b2272ee (04f834b1-54d3-4852-98c2-0cda3b2272ee): created successfully Jul 17 05:37:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d51560-c8a8-4eab-86ea-9e8af6609e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (4fdc15be-2a27-4d32-8714-6502b67bc703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6583daa8-ebf5-4441-9116-de5550388ae1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created volume successfully. Jul 17 05:37:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Creating offline snapshot fd6db6c5-6383-4453-847d-3b2a6ceddbe3 of volume 04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:37:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e40790-cf74-4173-b76c-50375bd4b19f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:49 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee Jul 17 05:37:49 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:49 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:49 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 1G Jul 17 05:37:49 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:50 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 1G" returned: 0 in 0.483s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f834b1-54d3-4852-98c2-0cda3b2272ee -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:50 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f834b1-54d3-4852-98c2-0cda3b2272ee -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 Jul 17 05:37:50 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:50 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f834b1-54d3-4852-98c2-0cda3b2272ee -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:50 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 is being set with open permissions: ugo+rw Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:50 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 Jul 17 05:37:50 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:50 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:50 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.info Jul 17 05:37:50 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:50 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.info" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:50 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.info is being set with open permissions: ugo+rw Jul 17 05:37:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:50 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.info Jul 17 05:37:50 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:51 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.info" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a3722390-574d-4dea-894d-15f31c0ccc8f tempest-CreateVolumesFromSnapshotTest-1473429591 None] Create snapshot completed successfully Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (4355c036-fd74-4b4f-aad0-e8656be37ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63f2480-c678-4807-918e-5d082d762dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63f2480-c678-4807-918e-5d082d762dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521680641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:53Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dde86b9-dec5-499f-81a2-ba9f52306ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dde86b9-dec5-499f-81a2-ba9f52306ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0657338f-d465-438f-92e2-2d377182c333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0657338f-d465-438f-92e2-2d377182c333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ff4ba8-a154-45d8-a8d9-6279aa56a3c8', 'volume_name': 'volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8de00f-ab24-4dfa-91d0-25196cfee054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8de00f-ab24-4dfa-91d0-25196cfee054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04be7ef1-8b1a-4adf-b871-6e2b8fbfbe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8', 'volume_size': 1} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521680641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:53Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Creating volume d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:52 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 1073741824 Jul 17 05:37:52 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (b59f48f7-017a-4eff-9aa0-df721eb36b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f983bffc-1fb5-4abb-98d3-7fa8c945a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f983bffc-1fb5-4abb-98d3-7fa8c945a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-479381185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709fa4e0-889a-45b3-878a-ba91184bc79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:53Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0f63fc-0e26-472b-8dbf-20535e56f794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0f63fc-0e26-472b-8dbf-20535e56f794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c179e-a2ac-406f-9db8-e71966925570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7c179e-a2ac-406f-9db8-e71966925570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709fa4e0-889a-45b3-878a-ba91184bc79d', 'volume_name': 'volume-709fa4e0-889a-45b3-878a-ba91184bc79d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58aa47e6-1e9d-4af1-8fb7-2a5b2b25bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58aa47e6-1e9d-4af1-8fb7-2a5b2b25bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408f57a9-a064-4002-84cc-ee92b5102391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume 709fa4e0-889a-45b3-878a-ba91184bc79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709fa4e0-889a-45b3-878a-ba91184bc79d', 'volume_size': 1} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:53 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 1073741824" returned: 0 in 0.584s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:53 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 Jul 17 05:37:53 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (9ee2a913-73c9-4337-9a2e-01a47c765011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996b8571-9056-4e82-a744-27f13ac452e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996b8571-9056-4e82-a744-27f13ac452e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784158386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87408531-4c4a-4a88-b7f1-0352b68333ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:54Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a267ee-b4d9-4a51-bd87-fed7c26134c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a267ee-b4d9-4a51-bd87-fed7c26134c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4025e80a-3be1-4b6d-89c6-73d8a1286f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4025e80a-3be1-4b6d-89c6-73d8a1286f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87408531-4c4a-4a88-b7f1-0352b68333ae', 'volume_name': 'volume-87408531-4c4a-4a88-b7f1-0352b68333ae', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8be917-017d-4b93-9a82-f54998587101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8be917-017d-4b93-9a82-f54998587101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0b17a2-96d6-49fc-bb16-f8dc11397db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume 87408531-4c4a-4a88-b7f1-0352b68333ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87408531-4c4a-4a88-b7f1-0352b68333ae', 'volume_size': 1} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:53 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-479381185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709fa4e0-889a-45b3-878a-ba91184bc79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:53Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Creating volume 709fa4e0-889a-45b3-878a-ba91184bc79d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:53 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04be7ef1-8b1a-4adf-b871-6e2b8fbfbe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:53 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d 1073741824 Jul 17 05:37:53 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e704b6e1-dbde-4d36-8cde-738c3fea0e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 (d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8): created successfully Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e704b6e1-dbde-4d36-8cde-738c3fea0e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (4355c036-fd74-4b4f-aad0-e8656be37ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-661d4c0a-73dc-4775-8042-c3c0a4b44a58 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created volume successfully. Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Flow 'volume_create_manager' (ec47b130-6b4b-4e25-b0aa-338126dd877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac19b3dd-b7f8-4831-a0e3-2e1fadb09d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac19b3dd-b7f8-4831-a0e3-2e1fadb09d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1942662262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720d7bed-d19c-4c9c-8447-9d52888cc127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f356b43924c5bae68064ecd20bddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:54Z,use_quota=True,user_id='632ef4c3c7d44e2ab80600aeca1799a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a888ba-f45a-45bb-8dd0-0cf9609218e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a888ba-f45a-45bb-8dd0-0cf9609218e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1ca94d-d123-491a-ba7d-b7ea0972e58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e1ca94d-d123-491a-ba7d-b7ea0972e58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720d7bed-d19c-4c9c-8447-9d52888cc127', 'volume_name': 'volume-720d7bed-d19c-4c9c-8447-9d52888cc127', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615d1125-d2e6-4ed7-952b-3ab272ac2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615d1125-d2e6-4ed7-952b-3ab272ac2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172c319-1d5d-4587-805b-c51094aae8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Volume 720d7bed-d19c-4c9c-8447-9d52888cc127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720d7bed-d19c-4c9c-8447-9d52888cc127', 'volume_size': 1} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (c9319e44-a71a-4b74-aef1-8505f840dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce918b25-0e95-4baa-927e-3386139fa351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce918b25-0e95-4baa-927e-3386139fa351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676039964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6925a3de-dec9-42ac-b0f0-31723ed67b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:54Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a6aadb-2233-4b8a-b616-c60368b5991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a6aadb-2233-4b8a-b616-c60368b5991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3610aa4-4930-45a0-ae97-5d1824f9ae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3610aa4-4930-45a0-ae97-5d1824f9ae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6925a3de-dec9-42ac-b0f0-31723ed67b9a', 'volume_name': 'volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91751778-d2d5-46f2-a73a-7724d73a203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91751778-d2d5-46f2-a73a-7724d73a203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c80967a-d5e1-4799-a13e-7c71a90ffd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume 6925a3de-dec9-42ac-b0f0-31723ed67b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a', 'volume_size': 1} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:54 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d 1073741824" returned: 0 in 0.656s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:54 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d Jul 17 05:37:54 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (0f72090d-2bbd-4fd7-b28d-92c661835dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6ef8c-4f6c-4162-8ade-83ef64c39163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6ef8c-4f6c-4162-8ade-83ef64c39163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63993976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d4ed0a-cf42-4392-86e5-f364c8b8f5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:55Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c481005-8bdd-4f53-bf5f-afc845fe7bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c481005-8bdd-4f53-bf5f-afc845fe7bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0005ad1b-5cee-4a23-9da2-ca44c4fbef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0005ad1b-5cee-4a23-9da2-ca44c4fbef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d4ed0a-cf42-4392-86e5-f364c8b8f5bd', 'volume_name': 'volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36104dc-6dbf-4392-8a0e-f1d48a083278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36104dc-6dbf-4392-8a0e-f1d48a083278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763dd67a-0cf1-4af9-8f8e-0427d2c4fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume 53d4ed0a-cf42-4392-86e5-f364c8b8f5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd', 'volume_size': 1} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:54 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784158386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87408531-4c4a-4a88-b7f1-0352b68333ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:54Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Creating volume 87408531-4c4a-4a88-b7f1-0352b68333ae {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408f57a9-a064-4002-84cc-ee92b5102391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709fa4e0-889a-45b3-878a-ba91184bc79d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b10b0d-f719-4d60-98a8-9c8d02976cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:54 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae 1073741824 Jul 17 05:37:54 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume volume-709fa4e0-889a-45b3-878a-ba91184bc79d (709fa4e0-889a-45b3-878a-ba91184bc79d): created successfully Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b10b0d-f719-4d60-98a8-9c8d02976cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (b59f48f7-017a-4eff-9aa0-df721eb36b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-80c7672d-7940-4f14-b9cf-bb3f61b5ea61 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created volume successfully. Jul 17 05:37:55 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae 1073741824" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:55 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae Jul 17 05:37:55 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:55 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1942662262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720d7bed-d19c-4c9c-8447-9d52888cc127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f356b43924c5bae68064ecd20bddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:54Z,use_quota=True,user_id='632ef4c3c7d44e2ab80600aeca1799a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Creating volume 720d7bed-d19c-4c9c-8447-9d52888cc127 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:55 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0b17a2-96d6-49fc-bb16-f8dc11397db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87408531-4c4a-4a88-b7f1-0352b68333ae', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:55 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 1073741824 Jul 17 05:37:55 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91279ff4-fe04-475b-b494-f147d05f34d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume volume-87408531-4c4a-4a88-b7f1-0352b68333ae (87408531-4c4a-4a88-b7f1-0352b68333ae): created successfully Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91279ff4-fe04-475b-b494-f147d05f34d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (9ee2a913-73c9-4337-9a2e-01a47c765011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e6cd02f0-e04b-4ff4-bb4a-3078bac6986b tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created volume successfully. Jul 17 05:37:56 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 1073741824" returned: 0 in 0.521s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:56 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 Jul 17 05:37:56 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:56 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:56 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:56 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.120s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676039964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6925a3de-dec9-42ac-b0f0-31723ed67b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:54Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Creating volume 6925a3de-dec9-42ac-b0f0-31723ed67b9a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:56 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:56 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a 1073741824 Jul 17 05:37:56 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172c319-1d5d-4587-805b-c51094aae8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720d7bed-d19c-4c9c-8447-9d52888cc127', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84245517-ca97-43d3-9c7f-5150df9ca4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Volume volume-720d7bed-d19c-4c9c-8447-9d52888cc127 (720d7bed-d19c-4c9c-8447-9d52888cc127): created successfully Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84245517-ca97-43d3-9c7f-5150df9ca4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Flow 'volume_create_manager' (ec47b130-6b4b-4e25-b0aa-338126dd877b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cd985cca-bb61-4cc5-9870-7a0d50ec7686 tempest-VolumesTransfersV355Test-1624149044 None] Created volume successfully. Jul 17 05:37:56 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:37:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:37:57 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a 1073741824" returned: 0 in 0.608s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:57 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a Jul 17 05:37:57 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Acquiring lock "cinder-96b87c7b-0332-4725-85f0-1452dd298e68-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Lock "cinder-96b87c7b-0332-4725-85f0-1452dd298e68-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Acquiring lock "cinder-quobyte-96b87c7b-0332-4725-85f0-1452dd298e68" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Lock "cinder-quobyte-96b87c7b-0332-4725-85f0-1452dd298e68" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade662f9-0a12-4714-9234-e271c09337b8]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:57 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.763s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63993976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d4ed0a-cf42-4392-86e5-f364c8b8f5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb90d7de2a9d4dca9715a788850b2a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:37:55Z,use_quota=True,user_id='59ef3c24dc5047ca9725712559992df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Creating volume 53d4ed0a-cf42-4392-86e5-f364c8b8f5bd {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:57 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:57 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:37:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:57 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd 1073741824 Jul 17 05:37:57 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c80967a-d5e1-4799-a13e-7c71a90ffd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849b7407-54fc-4ec0-8627-55f2ae194cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a (6925a3de-dec9-42ac-b0f0-31723ed67b9a): created successfully Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849b7407-54fc-4ec0-8627-55f2ae194cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (c9319e44-a71a-4b74-aef1-8505f840dddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4e633336-6f47-49f4-a690-b5fb605d89d6 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created volume successfully. Jul 17 05:37:57 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68" returned: 0 in 0.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-991d7542-55f9-475a-a1c5-770a885bdb34 tempest-VolumesTransfersV355Test-1068409276 None] Transfer volume completed successfully. Jul 17 05:37:57 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68 Jul 17 05:37:57 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:58 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd 1073741824" returned: 0 in 0.568s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:58 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-96b87c7b-0332-4725-85f0-1452dd298e68" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:58 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd Jul 17 05:37:58 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Lock "cinder-quobyte-96b87c7b-0332-4725-85f0-1452dd298e68" released by "delete_volume" :: held 0.799s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Created reservations ['8630163e-64d0-408d-bb1a-e73be1777250', 'a336cc69-f533-4fe5-af9b-56de03efe8aa', '12c112fd-39a4-4c4a-b225-d100236b2120', '6f9f062d-898f-4ad3-a86f-e20320fa3737'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:58 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:58 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:58 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Acquiring lock "cinder-720d7bed-d19c-4c9c-8447-9d52888cc127-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763dd67a-0cf1-4af9-8f8e-0427d2c4fb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1f8521-73f5-4710-9bb8-262ef14d0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-720d7bed-d19c-4c9c-8447-9d52888cc127-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Volume volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd (53d4ed0a-cf42-4392-86e5-f364c8b8f5bd): created successfully Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1f8521-73f5-4710-9bb8-262ef14d0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Flow 'volume_create_manager' (0f72090d-2bbd-4fd7-b28d-92c661835dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:37:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7009325b-5e74-4cd9-a604-94b339ef97c8 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created volume successfully. Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Acquiring lock "cinder-quobyte-720d7bed-d19c-4c9c-8447-9d52888cc127" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-quobyte-720d7bed-d19c-4c9c-8447-9d52888cc127" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[20072871-8b73-4e82-a7db-84373a563a21]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:58 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Deleted volume successfully. Jul 17 05:37:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c1213fc9-a684-4f00-8588-0a27c0c2fa58 tempest-VolumesNegativeTest-471379366 None] Lock "cinder-96b87c7b-0332-4725-85f0-1452dd298e68-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:58 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 Jul 17 05:37:58 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:59 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127" returned: 0 in 0.426s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:59 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127 Jul 17 05:37:59 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:59 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-720d7bed-d19c-4c9c-8447-9d52888cc127" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-quobyte-720d7bed-d19c-4c9c-8447-9d52888cc127" released by "delete_volume" :: held 0.782s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b515a0b-a78e-4237-bffd-b33d9962beea]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Created reservations ['5c94d6e2-90cd-4430-b3d6-9b3be36486c5', '015e32a7-da64-40df-adc1-a3d7c7c65118', '4b95a9b8-eddd-415e-97be-9a59f6b9c349', '31fd75ca-69c8-4b8d-a579-5052b6355b41'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:37:59 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd Jul 17 05:37:59 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:59 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:37:59 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:59 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:37:59 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 17 05:37:59 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd Jul 17 05:37:59 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.325s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:37:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Deleted volume successfully. Jul 17 05:37:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6bf65111-88e1-4945-8281-09e68031cd08 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-720d7bed-d19c-4c9c-8447-9d52888cc127-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:00 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd" released by "delete_volume" :: held 0.815s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created reservations ['7d800470-fa4f-4ed9-bfeb-d78644d9a3bb', 'b862933f-cd6f-4de4-a055-24b8f45758d8', 'c5370ab3-fbe2-43dc-a992-d8886329eb98', '318a82e2-7eed-488b-a747-02b3279d9ea9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Flow 'volume_create_manager' (31a722fa-8fbe-46ef-b22c-164eb4bd3f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bfdb22-6625-49d6-b711-b5cb8325bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bfdb22-6625-49d6-b711-b5cb8325bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2071150145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753bdab8-f3ab-4738-8cb2-dbb3137c91dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f356b43924c5bae68064ecd20bddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:00Z,use_quota=True,user_id='632ef4c3c7d44e2ab80600aeca1799a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efafe810-a2a0-47f0-8752-28457b93a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efafe810-a2a0-47f0-8752-28457b93a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe15cca1-5f84-4abb-a5d6-3e4498cc11bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe15cca1-5f84-4abb-a5d6-3e4498cc11bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753bdab8-f3ab-4738-8cb2-dbb3137c91dd', 'volume_name': 'volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e830bef4-a7b6-46ee-8516-44804f8d896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e830bef4-a7b6-46ee-8516-44804f8d896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10605ec9-df97-4087-8df4-c2db73f1587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Volume 753bdab8-f3ab-4738-8cb2-dbb3137c91dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd', 'volume_size': 1} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2071150145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753bdab8-f3ab-4738-8cb2-dbb3137c91dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f356b43924c5bae68064ecd20bddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:00Z,use_quota=True,user_id='632ef4c3c7d44e2ab80600aeca1799a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Creating volume 753bdab8-f3ab-4738-8cb2-dbb3137c91dd {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:00 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:00 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd 1073741824 Jul 17 05:38:00 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-6925a3de-dec9-42ac-b0f0-31723ed67b9a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:00 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:00 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-6925a3de-dec9-42ac-b0f0-31723ed67b9a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-6925a3de-dec9-42ac-b0f0-31723ed67b9a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-6925a3de-dec9-42ac-b0f0-31723ed67b9a" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340262b-4e66-4ac1-9c08-f8b4d97f0003]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:00 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a Jul 17 05:38:00 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:00 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Deleted volume successfully. Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d7845228-a654-4618-adc6-edee6a501b15 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-53d4ed0a-cf42-4392-86e5-f364c8b8f5bd-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:00 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd 1073741824" returned: 0 in 0.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:01 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd Jul 17 05:38:01 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:01 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a" returned: 0 in 0.457s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:01 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a Jul 17 05:38:01 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:01 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10605ec9-df97-4087-8df4-c2db73f1587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f5beae-dc06-48bf-a946-537007af929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:01 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6925a3de-dec9-42ac-b0f0-31723ed67b9a" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Volume volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd (753bdab8-f3ab-4738-8cb2-dbb3137c91dd): created successfully Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f5beae-dc06-48bf-a946-537007af929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Flow 'volume_create_manager' (31a722fa-8fbe-46ef-b22c-164eb4bd3f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-6925a3de-dec9-42ac-b0f0-31723ed67b9a" released by "delete_volume" :: held 0.827s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cb2b0285-d697-4d80-a3c3-7b638eab0527 tempest-VolumesTransfersV355Test-1624149044 None] Created volume successfully. Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created reservations ['db828553-0ccc-4567-90bd-71716e30fe69', '71657a6f-ce90-483f-ba2f-19eee2c08448', 'fdbcd103-59d2-42a6-a8e3-e0ea62dfeed3', '8dd6ee50-6c2f-4035-bb06-23ef7fbc6022'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:01 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:01 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-87408531-4c4a-4a88-b7f1-0352b68333ae-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-87408531-4c4a-4a88-b7f1-0352b68333ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-87408531-4c4a-4a88-b7f1-0352b68333ae" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-87408531-4c4a-4a88-b7f1-0352b68333ae" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:01 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Deleted volume successfully. Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[acec8592-1cc3-45eb-bd11-a8ca6305261c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e09b8b7d-b8eb-42a3-8fae-2bfa24e7b835 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-6925a3de-dec9-42ac-b0f0-31723ed67b9a-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:01 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae Jul 17 05:38:01 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:02 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:02 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae Jul 17 05:38:02 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:02 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-87408531-4c4a-4a88-b7f1-0352b68333ae" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-87408531-4c4a-4a88-b7f1-0352b68333ae" released by "delete_volume" :: held 0.769s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created reservations ['2151ba36-3c25-4526-95e6-bc41261d805e', '62f71f33-0479-4315-b021-a01fe2059816', 'a2fc541d-e7ff-41eb-9891-e1734a74365e', 'aa4247c2-62cc-49a0-86ea-45854efe3852'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Acquiring lock "cinder-753bdab8-f3ab-4738-8cb2-dbb3137c91dd-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:02 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:02 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-753bdab8-f3ab-4738-8cb2-dbb3137c91dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Acquiring lock "cinder-quobyte-753bdab8-f3ab-4738-8cb2-dbb3137c91dd" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-quobyte-753bdab8-f3ab-4738-8cb2-dbb3137c91dd" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[020d051e-df83-4e7f-9824-60584c5b2818]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-709fa4e0-889a-45b3-878a-ba91184bc79d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-709fa4e0-889a-45b3-878a-ba91184bc79d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-709fa4e0-889a-45b3-878a-ba91184bc79d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-709fa4e0-889a-45b3-878a-ba91184bc79d" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd93a920-db8f-4f15-9123-057db0e38629]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:03 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd Jul 17 05:38:03 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:03 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Deleted volume successfully. Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-726160db-cd2f-4b97-97d1-a510e1a038a3 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-87408531-4c4a-4a88-b7f1-0352b68333ae-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:03 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d Jul 17 05:38:03 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:03 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd" returned: 0 in 0.480s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:03 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd Jul 17 05:38:03 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:03 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:03 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d Jul 17 05:38:03 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:03 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-753bdab8-f3ab-4738-8cb2-dbb3137c91dd" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-quobyte-753bdab8-f3ab-4738-8cb2-dbb3137c91dd" released by "delete_volume" :: held 0.816s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Created reservations ['f3d47c6c-b074-4983-b59d-845d6578b77f', '79c3664d-32e2-4331-bed7-b1546e362cbf', 'be63c001-948b-4fe9-8809-4a0256458ca9', '651f53f9-d885-4c51-9ff9-8c4fc3e3e581'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:03 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-709fa4e0-889a-45b3-878a-ba91184bc79d" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-709fa4e0-889a-45b3-878a-ba91184bc79d" released by "delete_volume" :: held 0.777s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:03 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:03 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created reservations ['87c4a17e-bc3d-4bfd-a89d-ebe4eb227d9e', '12d4dd63-b133-4c1f-8939-758dbec9068e', 'b4cab21b-d2f0-448a-b119-e607fcebfc3b', '5b8e0a92-37ef-4b14-88c7-dedad7824351'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:04 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:04 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:04 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.477s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Deleted volume successfully. Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ba3a3b-0dd2-4efd-865d-c9ba4863cd70]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:04 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f67306ec-58ea-4f39-937f-ba7add9cffd0 tempest-VolumesTransfersV355Test-1576864866 None] Lock "cinder-753bdab8-f3ab-4738-8cb2-dbb3137c91dd-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.371s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Deleted volume successfully. Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9249863f-3819-4256-a76d-736bae6096f1 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-709fa4e0-889a-45b3-878a-ba91184bc79d-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:04 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 Jul 17 05:38:04 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:04 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:04 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8 Jul 17 05:38:04 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:05 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8" returned: 0 in 0.331s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8" released by "delete_volume" :: held 0.814s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created reservations ['9ec284ed-ca98-466f-8c9b-0d1f23ee49fb', '61042cae-b1f7-4a05-b5ab-a842907b833a', 'a51e8819-6328-4204-9017-947a7510a764', 'bfa8a1d9-5e0e-444a-90d0-17908b8c2d30'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:05 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:05 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-fd6db6c5-6383-4453-847d-3b2a6ceddbe3-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-fd6db6c5-6383-4453-847d-3b2a6ceddbe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-04f834b1-54d3-4852-98c2-0cda3b2272ee" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-04f834b1-54d3-4852-98c2-0cda3b2272ee" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-fd6db6c5-6383-4453-847d-3b2a6ceddbe3" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-fd6db6c5-6383-4453-847d-3b2a6ceddbe3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Deleting offline snapshot fd6db6c5-6383-4453-847d-3b2a6ceddbe3 of volume 04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] snapshot_file for this snap is: volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cc4d7-8541-41b4-9f1d-5d8ec865d70f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:05 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Deleted volume successfully. Jul 17 05:38:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-59d01893-017e-4fce-ac93-ecd178b12178 tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-d9ff4ba8-a154-45d8-a8d9-6279aa56a3c8-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:05 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 Jul 17 05:38:05 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:06 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f834b1-54d3-4852-98c2-0cda3b2272ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:38:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c0d58-af4b-4b57-913e-b273403d782e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:06 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee Jul 17 05:38:06 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:06 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee" returned: 0 in 0.517s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:06 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 Jul 17 05:38:06 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:07 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:07 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3 Jul 17 05:38:07 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:07 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee.fd6db6c5-6383-4453-847d-3b2a6ceddbe3" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=277,cinder:SELECT=195,cinder:INSERT=71,cinder:DELETE=24 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-fd6db6c5-6383-4453-847d-3b2a6ceddbe3" released by "_delete_snapshot" :: held 1.897s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-04f834b1-54d3-4852-98c2-0cda3b2272ee" released by "delete_snapshot" :: held 1.940s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created reservations ['50a5eb81-be2e-479c-90a2-f0817742921b', '3225f924-cc56-4008-8c61-1eff61b06162', '1f9ce602-24c2-4a44-80fb-02b5a4f6c273', 'e7768c82-923c-4887-95de-b79925ffc668'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Delete snapshot completed successfully. Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-00e49686-a049-400a-bf13-43d7f199412e tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-fd6db6c5-6383-4453-847d-3b2a6ceddbe3-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-04f834b1-54d3-4852-98c2-0cda3b2272ee-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-04f834b1-54d3-4852-98c2-0cda3b2272ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "cinder-quobyte-04f834b1-54d3-4852-98c2-0cda3b2272ee" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-04f834b1-54d3-4852-98c2-0cda3b2272ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc97f70-eb53-442a-ab67-44833c43ab6a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:07 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee Jul 17 05:38:07 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:08 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee" returned: 0 in 0.417s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:08 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee Jul 17 05:38:08 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:08 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-04f834b1-54d3-4852-98c2-0cda3b2272ee" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-quobyte-04f834b1-54d3-4852-98c2-0cda3b2272ee" released by "delete_volume" :: held 0.816s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Created reservations ['2324651d-00a4-48aa-88a2-42e3918d0780', '180b36b2-7dc5-4d24-9004-a9e792fe2acf', 'ea4af831-e2c8-4714-8dba-4ee5ecc0985d', 'eb97675b-3ddd-464a-a040-a545a7a5f99f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:08 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:08 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:09 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:09 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Deleted volume successfully. Jul 17 05:38:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4431de9-93a5-486b-8a79-e14dede5d55d tempest-CreateVolumesFromSnapshotTest-1473429591 None] Lock "cinder-04f834b1-54d3-4852-98c2-0cda3b2272ee-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (43cdfd6d-d64f-4383-83ee-470cc11a02e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8599d69-2058-4dd0-9341-df44c84169ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8599d69-2058-4dd0-9341-df44c84169ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-382362415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07996c93-f033-4245-bee7-83e601270e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:15Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bdf596-c98d-444e-bc25-78d98b17c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bdf596-c98d-444e-bc25-78d98b17c203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879e242c-1ae1-4e31-ae0c-e33d7dcc7975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879e242c-1ae1-4e31-ae0c-e33d7dcc7975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07996c93-f033-4245-bee7-83e601270e97', 'volume_name': 'volume-07996c93-f033-4245-bee7-83e601270e97', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5b8b9c-e182-4737-9088-dcc138256a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5b8b9c-e182-4737-9088-dcc138256a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45995478-a08c-4a0e-8187-82691f5af006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume 07996c93-f033-4245-bee7-83e601270e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07996c93-f033-4245-bee7-83e601270e97', 'volume_size': 1} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-382362415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07996c93-f033-4245-bee7-83e601270e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:15Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Creating volume 07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:14 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 1073741824 Jul 17 05:38:14 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:15 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 1073741824" returned: 0 in 0.488s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:15 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 Jul 17 05:38:15 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:15 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97" returned: 0 in 0.270s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45995478-a08c-4a0e-8187-82691f5af006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07996c93-f033-4245-bee7-83e601270e97', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcd46cd-bf9b-4eea-850c-afe709e87bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume volume-07996c93-f033-4245-bee7-83e601270e97 (07996c93-f033-4245-bee7-83e601270e97): created successfully Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcd46cd-bf9b-4eea-850c-afe709e87bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (43cdfd6d-d64f-4383-83ee-470cc11a02e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-202cdd18-460c-45af-92d1-7c80d5451e44 tempest-VolumesSnapshotTestJSON-2114227263 None] Created volume successfully. Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Flow 'volume_create_manager' (df15b6f7-e6f9-4f4b-ab96-d43e6a2c9f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef09424-0e8e-40eb-8daa-48ee3132edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef09424-0e8e-40eb-8daa-48ee3132edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6daf19-5feb-4fa5-9902-d973e5371f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ad6f919444426878cc9e574122c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:17Z,use_quota=True,user_id='c4efdb0847454b2eab9a2b8737c477ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6744a86-6b45-4d28-8b8f-7b291fbb5701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6744a86-6b45-4d28-8b8f-7b291fbb5701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8ff8f9-5efa-4193-860a-19d329546bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:16 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8ff8f9-5efa-4193-860a-19d329546bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f6daf19-5feb-4fa5-9902-d973e5371f5a', 'volume_name': 'volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a', 'volume_size': 1, 'image_id': 'b64f515c-ebbd-4583-b511-532f67ad66d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b64f515c-ebbd-4583-b511-532f67ad66d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6853901b7352470e72addd40b386d35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec8ad6f919444426878cc9e574122c05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ff3bd6f2779e255f089cbb49174de2843d459d2500eac5f693a37614126ba1021a1846955cf8f3e66cd92b539e2c7b6f562ee70c06d432fedf90b46996d8371', 'id': 'b64f515c-ebbd-4583-b511-532f67ad66d2', 'created_at': datetime.datetime(2026, 7, 17, 3, 38, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 38, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b64f515c-ebbd-4583-b511-532f67ad66d2/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56367082-1e6b-4657-8d7c-482033df23e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56367082-1e6b-4657-8d7c-482033df23e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d55f96-7411-4a02-98a2-cf711b92c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Volume 5f6daf19-5feb-4fa5-9902-d973e5371f5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a', 'volume_size': 1, 'image_id': 'b64f515c-ebbd-4583-b511-532f67ad66d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b64f515c-ebbd-4583-b511-532f67ad66d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6853901b7352470e72addd40b386d35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec8ad6f919444426878cc9e574122c05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ff3bd6f2779e255f089cbb49174de2843d459d2500eac5f693a37614126ba1021a1846955cf8f3e66cd92b539e2c7b6f562ee70c06d432fedf90b46996d8371', 'id': 'b64f515c-ebbd-4583-b511-532f67ad66d2', 'created_at': datetime.datetime(2026, 7, 17, 3, 38, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 38, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b64f515c-ebbd-4583-b511-532f67ad66d2/file', 'properties': {}}, 'image_service': } Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Trying to clone 5f6daf19-5feb-4fa5-9902-d973e5371f5a from image b64f515c-ebbd-4583-b511-532f67ad66d2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b64f515c-ebbd-4583-b511-532f67ad66d2', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Creating offline snapshot 8cdea096-c5e4-40d2-a090-81c4d49717c8 of volume 07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c649c71-83b5-45bd-9a8a-ce80e70df714]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:38:17 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Image download 0.00 MB at 0.00 MB/s Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4795a932-8787-41b6-a444-4f124827f21b]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:17 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 Jul 17 05:38:17 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:17 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD Jul 17 05:38:17 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:18 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97" returned: 0 in 0.564s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:18 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:18 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 1G Jul 17 05:38:18 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:18 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD Jul 17 05:38:18 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:18 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD" returned: 1 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:38:18 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Temporary image b64f515c-ebbd-4583-b511-532f67ad66d2 is fetched for user c4efdb0847454b2eab9a2b8737c477ac. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 1G" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07996c93-f033-4245-bee7-83e601270e97 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:18 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07996c93-f033-4245-bee7-83e601270e97 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 Jul 17 05:38:18 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e084c5-2dda-4553-8bc9-06079dcbd560]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:18 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD Jul 17 05:38:18 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:18 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07996c93-f033-4245-bee7-83e601270e97 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:18 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 is being set with open permissions: ugo+rw Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:18 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 Jul 17 05:38:18 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:18 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:19 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD Jul 17 05:38:19 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:19 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:19 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.info Jul 17 05:38:19 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:19 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:19 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.info" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:19 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.info is being set with open permissions: ugo+rw Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:19 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.info Jul 17 05:38:19 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:19 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.info" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6daf19-5feb-4fa5-9902-d973e5371f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ad6f919444426878cc9e574122c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:17Z,use_quota=True,user_id='c4efdb0847454b2eab9a2b8737c477ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Creating volume 5f6daf19-5feb-4fa5-9902-d973e5371f5a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:19 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a 1073741824 Jul 17 05:38:19 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a3130202-497c-40e6-99fa-2407600d1c05 tempest-VolumesSnapshotTestJSON-2114227263 None] Create snapshot completed successfully Jul 17 05:38:20 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a 1073741824" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:20 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a Jul 17 05:38:20 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:20 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Attempting download of b64f515c-ebbd-4583-b511-532f67ad66d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b64f515c-ebbd-4583-b511-532f67ad66d2', 'metadata': {}}])) to volume 5f6daf19-5feb-4fa5-9902-d973e5371f5a. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0634a7d7-b1d0-47b5-ab01-c6aafe0a03df]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b64f515c-ebbd-4583-b511-532f67ad66d2_oizeib3h {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-8cdea096-c5e4-40d2-a090-81c4d49717c8-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-8cdea096-c5e4-40d2-a090-81c4d49717c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-07996c93-f033-4245-bee7-83e601270e97" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-07996c93-f033-4245-bee7-83e601270e97" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-8cdea096-c5e4-40d2-a090-81c4d49717c8" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-8cdea096-c5e4-40d2-a090-81c4d49717c8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Deleting offline snapshot 8cdea096-c5e4-40d2-a090-81c4d49717c8 of volume 07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:38:20 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b64f515c-ebbd-4583-b511-532f67ad66d2_oizeib3h Jul 17 05:38:20 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] snapshot_file for this snap is: volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fdaecb-ef12-4462-894a-e7573ca2e3ac]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:21 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 Jul 17 05:38:21 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:21 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b64f515c-ebbd-4583-b511-532f67ad66d2_oizeib3h" returned: 0 in 0.526s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b64f515c-ebbd-4583-b511-532f67ad66d2_oizeib3h {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:21 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b64f515c-ebbd-4583-b511-532f67ad66d2_oizeib3h Jul 17 05:38:21 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:21 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8" returned: 0 in 0.608s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07996c93-f033-4245-bee7-83e601270e97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7324ee-ef5b-4775-ac49-3c9bdb43ed4a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:21 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b64f515c-ebbd-4583-b511-532f67ad66d2_oizeib3h" returned: 1 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b64f515c-ebbd-4583-b511-532f67ad66d2_oizeib3h' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2628d8-af39-4787-8fb9-e43ec682383f]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:21 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 Jul 17 05:38:21 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:21 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD Jul 17 05:38:21 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:22 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97" returned: 0 in 0.482s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:22 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:22 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 Jul 17 05:38:22 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:22 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD Jul 17 05:38:22 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:22 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] b64f515c-ebbd-4583-b511-532f67ad66d2 was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:22 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:22 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a Jul 17 05:38:22 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:22 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8 Jul 17 05:38:22 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:22 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97.8cdea096-c5e4-40d2-a090-81c4d49717c8" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-8cdea096-c5e4-40d2-a090-81c4d49717c8" released by "_delete_snapshot" :: held 1.941s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-07996c93-f033-4245-bee7-83e601270e97" released by "delete_snapshot" :: held 1.979s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['455a1a7f-38bc-4546-9b58-74ddf4169fbc', 'c7fc3eeb-6f9a-4b40-b3b0-e463f44dbb16', '8a13f7be-6f8b-4dcc-95e8-3a72c69d088d', '7a8cd20c-6019-421e-9889-bb62cf8564e1'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Delete snapshot completed successfully. Jul 17 05:38:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95524cdf-f050-47fd-8c03-f4b5bc8d64f7 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-8cdea096-c5e4-40d2-a090-81c4d49717c8-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:23 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a" returned: 0 in 0.582s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b64f515c-ebbd-4583-b511-532f67ad66d2_fh2n3gp_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:38:23 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:23 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a 1G Jul 17 05:38:23 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:23 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a 1G" returned: 0 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Downloaded image b64f515c-ebbd-4583-b511-532f67ad66d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b64f515c-ebbd-4583-b511-532f67ad66d2', 'metadata': {}}])) to volume 5f6daf19-5feb-4fa5-9902-d973e5371f5a successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Temporary image b64f515c-ebbd-4583-b511-532f67ad66d2 for user c4efdb0847454b2eab9a2b8737c477ac is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Marking volume 5f6daf19-5feb-4fa5-9902-d973e5371f5a as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Copying metadata from image b64f515c-ebbd-4583-b511-532f67ad66d2 to 5f6daf19-5feb-4fa5-9902-d973e5371f5a. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Creating volume glance metadata for volume 5f6daf19-5feb-4fa5-9902-d973e5371f5a backed by image b64f515c-ebbd-4583-b511-532f67ad66d2 with: {'image_id': 'b64f515c-ebbd-4583-b511-532f67ad66d2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c6853901b7352470e72addd40b386d35', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d55f96-7411-4a02-98a2-cf711b92c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a', 'volume_size': 1, 'image_id': 'b64f515c-ebbd-4583-b511-532f67ad66d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b64f515c-ebbd-4583-b511-532f67ad66d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6853901b7352470e72addd40b386d35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec8ad6f919444426878cc9e574122c05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6ff3bd6f2779e255f089cbb49174de2843d459d2500eac5f693a37614126ba1021a1846955cf8f3e66cd92b539e2c7b6f562ee70c06d432fedf90b46996d8371', 'id': 'b64f515c-ebbd-4583-b511-532f67ad66d2', 'created_at': datetime.datetime(2026, 7, 17, 3, 38, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 38, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b64f515c-ebbd-4583-b511-532f67ad66d2/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386bb57d-04ac-484a-acde-9b6d8abee302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Volume volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a (5f6daf19-5feb-4fa5-9902-d973e5371f5a): created successfully Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386bb57d-04ac-484a-acde-9b6d8abee302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Flow 'volume_create_manager' (df15b6f7-e6f9-4f4b-ab96-d43e6a2c9f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b93352e4-e10f-4e2d-8987-5767dca40a93 tempest-VolumeImageDependencyTests-1460001762 None] Created volume successfully. Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Acquiring lock "cinder-5f6daf19-5feb-4fa5-9902-d973e5371f5a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Lock "cinder-5f6daf19-5feb-4fa5-9902-d973e5371f5a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (11463399-20f0-46b9-84fc-aa83b6b38e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33d879d-e3c4-479d-8b25-e12c14f1971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Acquiring lock "cinder-quobyte-5f6daf19-5feb-4fa5-9902-d973e5371f5a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33d879d-e3c4-479d-8b25-e12c14f1971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-7493775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e647c-a226-4041-bf68-3ceaeb7459fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:25Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b253c395-a1dd-4ffc-b5a3-cfcdde745679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b253c395-a1dd-4ffc-b5a3-cfcdde745679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f19ce98-558e-4e68-bfa1-a16b133b36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f19ce98-558e-4e68-bfa1-a16b133b36af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60e647c-a226-4041-bf68-3ceaeb7459fa', 'volume_name': 'volume-d60e647c-a226-4041-bf68-3ceaeb7459fa', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10c7770-dfa1-45a0-adb3-f1ef4783218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10c7770-dfa1-45a0-adb3-f1ef4783218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4da1e84-07e3-4b3e-92e0-9bdeade52ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Volume d60e647c-a226-4041-bf68-3ceaeb7459fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60e647c-a226-4041-bf68-3ceaeb7459fa', 'volume_size': 1} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-7493775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e647c-a226-4041-bf68-3ceaeb7459fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:25Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Creating volume d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:24 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Lock "cinder-quobyte-5f6daf19-5feb-4fa5-9902-d973e5371f5a" acquired by "delete_volume" :: waited 0.103s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:24 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa 1073741824 Jul 17 05:38:24 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b85d4c3-4572-412b-bf75-d4480a1f2fa5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:24 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a Jul 17 05:38:24 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:25 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a" returned: 0 in 0.429s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:25 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa 1073741824" returned: 0 in 0.510s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:25 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a Jul 17 05:38:25 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:25 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa Jul 17 05:38:25 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:25 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5f6daf19-5feb-4fa5-9902-d973e5371f5a" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Lock "cinder-quobyte-5f6daf19-5feb-4fa5-9902-d973e5371f5a" released by "delete_volume" :: held 0.751s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:25 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Created reservations ['09cf9dd1-dc68-4b93-991e-fe474a62433a', 'e7aabdc6-2841-4199-9b50-ba70414e5386', 'cb70d030-e5a6-494d-8830-cefa6a7d14b5', 'd970c891-3b21-4234-936f-b59a652d0b46'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4da1e84-07e3-4b3e-92e0-9bdeade52ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60e647c-a226-4041-bf68-3ceaeb7459fa', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3511bbbb-7611-4086-b413-6806a436f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Volume volume-d60e647c-a226-4041-bf68-3ceaeb7459fa (d60e647c-a226-4041-bf68-3ceaeb7459fa): created successfully Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3511bbbb-7611-4086-b413-6806a436f80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (11463399-20f0-46b9-84fc-aa83b6b38e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3a85e630-27d7-4a27-898d-2af58a466c5c tempest-VolumesSnapshotTestJSON-2114227263 None] Created volume successfully. Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:25 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:25 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:25 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:25 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Deleted volume successfully. Jul 17 05:38:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6edb6a07-b8a2-43b0-b1db-23692f763edd tempest-VolumeImageDependencyTests-1460001762 None] Lock "cinder-5f6daf19-5feb-4fa5-9902-d973e5371f5a-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Creating offline snapshot 1be966df-000a-4cde-b980-b46340016d14 of volume d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:38:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[38381849-52ae-40b0-970a-cf623f695f0e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:27 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa Jul 17 05:38:27 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:27 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa" returned: 0 in 0.399s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:27 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 1G Jul 17 05:38:27 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:27 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 1G" returned: 0 in 0.617s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60e647c-a226-4041-bf68-3ceaeb7459fa -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:27 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60e647c-a226-4041-bf68-3ceaeb7459fa -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 Jul 17 05:38:27 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:28 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60e647c-a226-4041-bf68-3ceaeb7459fa -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 is being set with open permissions: ugo+rw Jul 17 05:38:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:28 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 Jul 17 05:38:28 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:28 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:28 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.info Jul 17 05:38:28 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:28 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.info" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.info is being set with open permissions: ugo+rw Jul 17 05:38:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:29 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.info Jul 17 05:38:29 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:29 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.info" returned: 0 in 0.309s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-20844528-d400-4452-a712-39d24408ebde tempest-VolumesSnapshotTestJSON-2114227263 None] Create snapshot completed successfully Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Flow 'volume_create_manager' (99f1c678-d1fb-4a93-b08d-8f219654ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d4b11b-ed51-49ef-808d-1ad88a8465d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d4b11b-ed51-49ef-808d-1ad88a8465d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da52caa2-7107-42a5-b5bf-85bfe5fa6939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6fdb329ce44559bd02ee285f58280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:30Z,use_quota=True,user_id='67cf69d3d9594f6aa12835e170a3463f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f69b5c-3839-414b-afc4-956dacfaf26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f69b5c-3839-414b-afc4-956dacfaf26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66870c2-325d-4b25-a709-00b0abf0c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66870c2-325d-4b25-a709-00b0abf0c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da52caa2-7107-42a5-b5bf-85bfe5fa6939', 'volume_name': 'volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a20cd91-ecca-4a0a-8b65-f7f355f6bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a20cd91-ecca-4a0a-8b65-f7f355f6bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099420ad-1d00-4ca6-aa65-bb6f57565f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Volume da52caa2-7107-42a5-b5bf-85bfe5fa6939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939', 'volume_size': 1} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da52caa2-7107-42a5-b5bf-85bfe5fa6939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6fdb329ce44559bd02ee285f58280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:30Z,use_quota=True,user_id='67cf69d3d9594f6aa12835e170a3463f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Creating volume da52caa2-7107-42a5-b5bf-85bfe5fa6939 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:29 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:29 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 1073741824 Jul 17 05:38:29 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:30 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 1073741824" returned: 0 in 0.576s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:30 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 Jul 17 05:38:30 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:30 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (51c069cd-ab73-4049-96c8-0fb29adffe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9ad81b-c347-44ca-b7c6-bdef32437de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099420ad-1d00-4ca6-aa65-bb6f57565f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a16f69-c506-4d0e-9209-05141df869c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9ad81b-c347-44ca-b7c6-bdef32437de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-644262727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf64aeb-db2f-4ebb-b281-b1fc1876477f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1be966df-000a-4cde-b980-b46340016d14,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:31Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e8f3d-ea84-4930-93fd-8a43fee0de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e8f3d-ea84-4930-93fd-8a43fee0de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b49fdc-7397-42d8-909e-45e20639fefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b49fdc-7397-42d8-909e-45e20639fefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcf64aeb-db2f-4ebb-b281-b1fc1876477f', 'volume_name': 'volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f', 'volume_size': 2, 'snapshot_id': '1be966df-000a-4cde-b980-b46340016d14'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4d50d7-ed77-4a80-9d88-af35327e4cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4d50d7-ed77-4a80-9d88-af35327e4cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe7987f-67d7-4e8b-a6ad-a984f549290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume bcf64aeb-db2f-4ebb-b281-b1fc1876477f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f', 'volume_size': 2, 'snapshot_id': '1be966df-000a-4cde-b980-b46340016d14'} Jul 17 05:38:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Volume volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 (da52caa2-7107-42a5-b5bf-85bfe5fa6939): created successfully Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a16f69-c506-4d0e-9209-05141df869c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Flow 'volume_create_manager' (99f1c678-d1fb-4a93-b08d-8f219654ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-1be966df-000a-4cde-b980-b46340016d14-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:30 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4b9db460-2f67-40a4-8cb0-1117690c47de tempest-CinderUnicodeTest-15122213 None] Created volume successfully. Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-1be966df-000a-4cde-b980-b46340016d14-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Creating volume bcf64aeb-db2f-4ebb-b281-b1fc1876477f from snapshot 1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] snapshot: 1be966df-000a-4cde-b980-b46340016d14, volume: bcf64aeb-db2f-4ebb-b281-b1fc1876477f, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c850f7-6716-432b-928f-1ba3e9db1ae3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:31 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 Jul 17 05:38:31 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:31 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d60e647c-a226-4041-bf68-3ceaeb7459fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db24b6-a509-4fdf-a76c-a725a5c6e4a8]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:31 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa Jul 17 05:38:31 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:31 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:38:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:31 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f Jul 17 05:38:31 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Flow 'volume_create_manager' (a100356b-41f1-4c9e-af97-8fcbacd0c9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deeea85f-dfac-46ce-8068-40eee6ab68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deeea85f-dfac-46ce-8068-40eee6ab68cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-983071236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac7394-d6b1-4313-a7d6-35958d32686c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6fdb329ce44559bd02ee285f58280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:32Z,use_quota=True,user_id='67cf69d3d9594f6aa12835e170a3463f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77b85af-6114-4f41-b170-bf52d5cf0a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77b85af-6114-4f41-b170-bf52d5cf0a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c030622-0043-4ceb-86d9-b5ffbe08815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c030622-0043-4ceb-86d9-b5ffbe08815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ac7394-d6b1-4313-a7d6-35958d32686c', 'volume_name': 'volume-d3ac7394-d6b1-4313-a7d6-35958d32686c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dc946b-fac7-4f0f-b4b8-25f72cf0d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dc946b-fac7-4f0f-b4b8-25f72cf0d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbce1d0-a149-4b6b-929f-2db1a1c42019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Volume d3ac7394-d6b1-4313-a7d6-35958d32686c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ac7394-d6b1-4313-a7d6-35958d32686c', 'volume_size': 1} Jul 17 05:38:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:37 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" returned: 0 in 5.642s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:37 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc1b75-0b20-4cc1-9822-ef81ebba9890]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:37 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa Jul 17 05:38:37 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:38 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa" returned: 0 in 0.588s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:38:38 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Converted 1024.00 MB image at 181.45 MB/s Jul 17 05:38:38 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f is being set with open permissions: ugo+rw Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:38 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f Jul 17 05:38:38 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:38 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" released by "_copy_volume_from_snapshot" :: held 7.419s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-1be966df-000a-4cde-b980-b46340016d14-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" released by "_create_volume_from_snapshot" :: held 7.453s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.475s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.946s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-983071236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac7394-d6b1-4313-a7d6-35958d32686c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6fdb329ce44559bd02ee285f58280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:32Z,use_quota=True,user_id='67cf69d3d9594f6aa12835e170a3463f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Creating volume d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:38 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:38 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c 1073741824 Jul 17 05:38:38 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe7987f-67d7-4e8b-a6ad-a984f549290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f', 'volume_size': 2, 'snapshot_id': '1be966df-000a-4cde-b980-b46340016d14'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac2ffec-05cb-44f2-a819-8087d36ba2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f (bcf64aeb-db2f-4ebb-b281-b1fc1876477f): created successfully Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac2ffec-05cb-44f2-a819-8087d36ba2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (51c069cd-ab73-4049-96c8-0fb29adffe8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7dcbfc3f-e05e-4cbd-a062-75147568d3e3 tempest-VolumesSnapshotTestJSON-2114227263 None] Created volume successfully. Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-bcf64aeb-db2f-4ebb-b281-b1fc1876477f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-bcf64aeb-db2f-4ebb-b281-b1fc1876477f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f123a0b-3ac6-4432-839e-a90e8cc9e517]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:38 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c 1073741824" returned: 0 in 0.553s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:39 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f Jul 17 05:38:39 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:39 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c Jul 17 05:38:39 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:39 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" returned: 0 in 0.415s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:39 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:39 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f Jul 17 05:38:39 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbce1d0-a149-4b6b-929f-2db1a1c42019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ac7394-d6b1-4313-a7d6-35958d32686c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1a2b84-891b-4465-a493-fcc5d9cb0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Volume volume-d3ac7394-d6b1-4313-a7d6-35958d32686c (d3ac7394-d6b1-4313-a7d6-35958d32686c): created successfully Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1a2b84-891b-4465-a493-fcc5d9cb0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Flow 'volume_create_manager' (a100356b-41f1-4c9e-af97-8fcbacd0c9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c20975d6-ce4d-4e18-b2c6-d188900ca257 tempest-CinderUnicodeTest-15122213 None] Created volume successfully. Jul 17 05:38:39 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" returned: 0 in 0.289s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-bcf64aeb-db2f-4ebb-b281-b1fc1876477f" released by "delete_volume" :: held 0.745s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['1c15edb8-dc92-4568-bc7c-f7530992409e', '141cd9e1-d083-4bb4-821c-a2134f7eab76', '0088a2a2-a09b-47ff-8ca3-fa12d0caee74', 'cf87be53-e278-460c-8171-afc8a1ce1b26'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:39 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:39 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:39 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:39 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Deleted volume successfully. Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cf1bff0-4ca5-4d3c-9764-7456ed11f71c tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-bcf64aeb-db2f-4ebb-b281-b1fc1876477f-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-1be966df-000a-4cde-b980-b46340016d14-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-1be966df-000a-4cde-b980-b46340016d14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-d60e647c-a226-4041-bf68-3ceaeb7459fa" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-d60e647c-a226-4041-bf68-3ceaeb7459fa" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-1be966df-000a-4cde-b980-b46340016d14" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-1be966df-000a-4cde-b980-b46340016d14" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Deleting offline snapshot 1be966df-000a-4cde-b980-b46340016d14 of volume d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] snapshot_file for this snap is: volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b9599f-37bd-45d9-9146-0b9df4748d73]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:40 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 Jul 17 05:38:40 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Creating offline snapshot fc08f988-e414-4dfd-a8cb-dc41f82de5f7 of volume d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84615e5-8cde-49d8-b81c-0df38245e7e7]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:40 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14" returned: 0 in 0.454s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d60e647c-a226-4041-bf68-3ceaeb7459fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:38:40 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c Jul 17 05:38:40 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afd9aeb-a74f-4612-8933-f901cde3863f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:40 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa Jul 17 05:38:40 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:40 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c" returned: 0 in 0.412s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:40 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 1G Jul 17 05:38:40 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:41 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:41 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 Jul 17 05:38:41 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Flow 'volume_create_manager' (a6910de4-9e92-4b9b-9247-1de244cc9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdffcbc-4f38-44d8-b688-57fe63e2304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdffcbc-4f38-44d8-b688-57fe63e2304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132177142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605d16f4-e915-4a9d-8706-6bf836fabc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ab9b8c0eee4465afcfaa26355ae52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:41Z,use_quota=True,user_id='11089c2c80b448de855d8ba843f7d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d40aa05-a013-4950-83ef-5cba81b9cb7c),volume_type_id=8d40aa05-a013-4950-83ef-5cba81b9cb7c)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511e7e2f-2cc5-4516-ba9f-3a86768317b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511e7e2f-2cc5-4516-ba9f-3a86768317b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38000ffd-0032-4603-b046-21b6e7da96c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38000ffd-0032-4603-b046-21b6e7da96c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605d16f4-e915-4a9d-8706-6bf836fabc08', 'volume_name': 'volume-605d16f4-e915-4a9d-8706-6bf836fabc08', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c02bb3-187e-4ce2-bb1e-d1791dea717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c02bb3-187e-4ce2-bb1e-d1791dea717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b45ea99-575d-4e93-b06b-7e57901aa186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume 605d16f4-e915-4a9d-8706-6bf836fabc08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605d16f4-e915-4a9d-8706-6bf836fabc08', 'volume_size': 1} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 1G" returned: 0 in 0.499s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ac7394-d6b1-4313-a7d6-35958d32686c -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:41 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ac7394-d6b1-4313-a7d6-35958d32686c -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 Jul 17 05:38:41 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:41 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14" returned: 0 in 0.484s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:41 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14 Jul 17 05:38:41 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Flow 'volume_create_manager' (f3b6ad31-9fbe-4f56-8740-630469338ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a278a422-ac69-49e7-9de1-5abde8b12f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a278a422-ac69-49e7-9de1-5abde8b12f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-541741724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c3708e-93c3-4da9-abda-d94283ba4c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ab9b8c0eee4465afcfaa26355ae52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:42Z,use_quota=True,user_id='11089c2c80b448de855d8ba843f7d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626488c5-7229-47b2-928e-3c7d2580e8ea),volume_type_id=626488c5-7229-47b2-928e-3c7d2580e8ea)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31db8a37-96f5-45df-bd3c-23b70916a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31db8a37-96f5-45df-bd3c-23b70916a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a890cac7-986d-418e-87f2-fe242a23fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a890cac7-986d-418e-87f2-fe242a23fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c3708e-93c3-4da9-abda-d94283ba4c71', 'volume_name': 'volume-79c3708e-93c3-4da9-abda-d94283ba4c71', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da9717a-a06a-44c0-8426-9b74c2ac5918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da9717a-a06a-44c0-8426-9b74c2ac5918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebeb518-f343-4ad8-8f32-74211d39a64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume 79c3708e-93c3-4da9-abda-d94283ba4c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c3708e-93c3-4da9-abda-d94283ba4c71', 'volume_size': 1} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ac7394-d6b1-4313-a7d6-35958d32686c -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:41 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 is being set with open permissions: ugo+rw Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:41 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 Jul 17 05:38:41 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:41 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa.1be966df-000a-4cde-b980-b46340016d14" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-1be966df-000a-4cde-b980-b46340016d14" released by "_delete_snapshot" :: held 1.831s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-d60e647c-a226-4041-bf68-3ceaeb7459fa" released by "delete_snapshot" :: held 1.874s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['b7d42b57-2f76-4644-9c1b-7af7a72026cc', 'ab6204e8-447e-460b-8313-c21a5941fcd4', 'c3e56481-2de8-4297-8c2c-a6adb65d2c09', 'f2dbc5a7-d015-4a38-abb9-579b9292e0f0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:42 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Delete snapshot completed successfully. Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-03582c88-bfb6-410c-a3e3-40eaeca90006 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-1be966df-000a-4cde-b980-b46340016d14-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:42 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.info Jul 17 05:38:42 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-d60e647c-a226-4041-bf68-3ceaeb7459fa-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Flow 'volume_create_manager' (bb1c4738-f1b1-404d-a289-276c59bb98f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f03763b-905e-41cd-aba7-41bd3a27a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f03763b-905e-41cd-aba7-41bd3a27a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825526370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12af98de-d8f8-4996-8ca2-29f2778e6b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ab9b8c0eee4465afcfaa26355ae52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:42Z,use_quota=True,user_id='11089c2c80b448de855d8ba843f7d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79abe84f-522f-4a5c-9358-236c77c39beb),volume_type_id=79abe84f-522f-4a5c-9358-236c77c39beb)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e33e0e7-77fd-4ac1-832c-c4ef318c06a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e33e0e7-77fd-4ac1-832c-c4ef318c06a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ce9542-936b-42bb-a59b-545ca1ff6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-d60e647c-a226-4041-bf68-3ceaeb7459fa-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-d60e647c-a226-4041-bf68-3ceaeb7459fa" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-d60e647c-a226-4041-bf68-3ceaeb7459fa" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f81737-752e-4f3a-b393-52277cd99a33]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:42 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.info" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:42 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.info is being set with open permissions: ugo+rw Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:42 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.info Jul 17 05:38:42 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:42 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa Jul 17 05:38:42 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ce9542-936b-42bb-a59b-545ca1ff6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12af98de-d8f8-4996-8ca2-29f2778e6b1c', 'volume_name': 'volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c', 'volume_size': 1, 'image_id': 'a059ad08-bba0-4fd0-9f21-091853694a3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a059ad08-bba0-4fd0-9f21-091853694a3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2005000880', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09ab9b8c0eee4465afcfaa26355ae52a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a059ad08-bba0-4fd0-9f21-091853694a3c', 'created_at': datetime.datetime(2026, 7, 17, 3, 38, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 38, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a059ad08-bba0-4fd0-9f21-091853694a3c/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa59244d-6669-4ff4-b62f-7130eeb48516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa59244d-6669-4ff4-b62f-7130eeb48516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7e428c-53ba-440b-82f4-1866ca9f45d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume 12af98de-d8f8-4996-8ca2-29f2778e6b1c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c', 'volume_size': 1, 'image_id': 'a059ad08-bba0-4fd0-9f21-091853694a3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a059ad08-bba0-4fd0-9f21-091853694a3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2005000880', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09ab9b8c0eee4465afcfaa26355ae52a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a059ad08-bba0-4fd0-9f21-091853694a3c', 'created_at': datetime.datetime(2026, 7, 17, 3, 38, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 38, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a059ad08-bba0-4fd0-9f21-091853694a3c/file', 'properties': {}}, 'image_service': } Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Trying to clone 12af98de-d8f8-4996-8ca2-29f2778e6b1c from image a059ad08-bba0-4fd0-9f21-091853694a3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a059ad08-bba0-4fd0-9f21-091853694a3c', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:38:42 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.info" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132177142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605d16f4-e915-4a9d-8706-6bf836fabc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ab9b8c0eee4465afcfaa26355ae52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:41Z,use_quota=True,user_id='11089c2c80b448de855d8ba843f7d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d40aa05-a013-4950-83ef-5cba81b9cb7c),volume_type_id=8d40aa05-a013-4950-83ef-5cba81b9cb7c)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Creating volume 605d16f4-e915-4a9d-8706-6bf836fabc08 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:42 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:42 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 1073741824 Jul 17 05:38:42 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:42 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3c7c507c-f504-4983-a7a6-057706ff35b8 tempest-CinderUnicodeTest-15122213 None] Create snapshot completed successfully Jul 17 05:38:42 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa Jul 17 05:38:42 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:43 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d60e647c-a226-4041-bf68-3ceaeb7459fa" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-d60e647c-a226-4041-bf68-3ceaeb7459fa" released by "delete_volume" :: held 0.773s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['4c83e656-9a54-4985-8ba9-27886ab1bd7f', 'd6c9c676-88ef-49ca-b4a0-9e4a445e4bcf', '29e451fe-cf84-4c94-920c-db5cf63a8c5c', '649d192a-863a-4ed9-a990-2dff63b29d18'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:43 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 1073741824" returned: 0 in 0.511s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:43 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 Jul 17 05:38:43 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:43 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:43 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:43 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08" returned: 0 in 0.336s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-541741724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c3708e-93c3-4da9-abda-d94283ba4c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ab9b8c0eee4465afcfaa26355ae52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:42Z,use_quota=True,user_id='11089c2c80b448de855d8ba843f7d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(626488c5-7229-47b2-928e-3c7d2580e8ea),volume_type_id=626488c5-7229-47b2-928e-3c7d2580e8ea)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Creating volume 79c3708e-93c3-4da9-abda-d94283ba4c71 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Acquiring lock "cinder-fc08f988-e414-4dfd-a8cb-dc41f82de5f7-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:43 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 1073741824 Jul 17 05:38:43 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:43 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b45ea99-575d-4e93-b06b-7e57901aa186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605d16f4-e915-4a9d-8706-6bf836fabc08', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed732c2-b20f-4169-9537-f474c4750433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Deleted volume successfully. Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Lock "cinder-fc08f988-e414-4dfd-a8cb-dc41f82de5f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.115s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Acquiring lock "cinder-quobyte-d3ac7394-d6b1-4313-a7d6-35958d32686c" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume volume-605d16f4-e915-4a9d-8706-6bf836fabc08 (605d16f4-e915-4a9d-8706-6bf836fabc08): created successfully Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed732c2-b20f-4169-9537-f474c4750433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Flow 'volume_create_manager' (a6910de4-9e92-4b9b-9247-1de244cc9a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-d3ac7394-d6b1-4313-a7d6-35958d32686c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Acquiring lock "cinder-quobyte-fc08f988-e414-4dfd-a8cb-dc41f82de5f7" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7baaefb-9e63-4b40-b4aa-f363f3f37b71 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-d60e647c-a226-4041-bf68-3ceaeb7459fa-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1526d774-5a4a-4894-8ea3-913e69b8921a tempest-TestInstancesWithCinderVolumes-1644132374 None] Created volume successfully. Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-fc08f988-e414-4dfd-a8cb-dc41f82de5f7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Deleting offline snapshot fc08f988-e414-4dfd-a8cb-dc41f82de5f7 of volume d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] snapshot_file for this snap is: volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdcb9a4-a955-458e-aaab-12c6745d6615]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:44 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 Jul 17 05:38:44 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (d2868ddf-7502-4f8a-9b8e-60b5dc21999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830b3f6-23ad-4858-bd59-e817ca59fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830b3f6-23ad-4858-bd59-e817ca59fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-610186604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b7997d-99c5-4b6f-bdd3-dc457d7c6505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:44Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccef7c2-73ce-40d7-b234-59f1528357ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccef7c2-73ce-40d7-b234-59f1528357ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:44 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c394b8c-c124-4936-ad39-590c6e186ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c394b8c-c124-4936-ad39-590c6e186ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b7997d-99c5-4b6f-bdd3-dc457d7c6505', 'volume_name': 'volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5fe1fb-d0bf-47fd-ad29-e9d9c6152724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5fe1fb-d0bf-47fd-ad29-e9d9c6152724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcdff84-b2eb-4eb7-9252-228cc0ca0099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume 76b7997d-99c5-4b6f-bdd3-dc457d7c6505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505', 'volume_size': 1} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 1073741824" returned: 0 in 0.560s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:44 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 Jul 17 05:38:44 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:44 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3ac7394-d6b1-4313-a7d6-35958d32686c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb3b058-6231-49a8-8202-7c0d715874c2]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:44 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c Jul 17 05:38:44 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:44 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-610186604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b7997d-99c5-4b6f-bdd3-dc457d7c6505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:44Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Creating volume 76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:44 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:44 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 1073741824 Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebeb518-f343-4ad8-8f32-74211d39a64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c3708e-93c3-4da9-abda-d94283ba4c71', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:44 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f95b82-bcbe-4971-8bfe-24df4244de46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume volume-79c3708e-93c3-4da9-abda-d94283ba4c71 (79c3708e-93c3-4da9-abda-d94283ba4c71): created successfully Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f95b82-bcbe-4971-8bfe-24df4244de46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Flow 'volume_create_manager' (f3b6ad31-9fbe-4f56-8740-630469338ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1f2efceb-2917-48b5-bf56-a5b0b5666685 tempest-TestInstancesWithCinderVolumes-1644132374 None] Created volume successfully. Jul 17 05:38:44 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:44 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 Jul 17 05:38:44 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:45 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 1073741824" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:45 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 Jul 17 05:38:45 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:45 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:45 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7 Jul 17 05:38:45 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:45 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcdff84-b2eb-4eb7-9252-228cc0ca0099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a6a713-c854-46e6-9030-ece412baa387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 (76b7997d-99c5-4b6f-bdd3-dc457d7c6505): created successfully Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a6a713-c854-46e6-9030-ece412baa387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:45 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (d2868ddf-7502-4f8a-9b8e-60b5dc21999a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c.fc08f988-e414-4dfd-a8cb-dc41f82de5f7" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4c1eb207-7bd3-4b0a-90e4-79f1613cb3b1 tempest-VolumesSnapshotTestJSON-2114227263 None] Created volume successfully. Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-fc08f988-e414-4dfd-a8cb-dc41f82de5f7" released by "_delete_snapshot" :: held 1.619s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-d3ac7394-d6b1-4313-a7d6-35958d32686c" released by "delete_snapshot" :: held 1.660s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Created reservations ['40acbee2-a735-4f1c-bc72-acca47653ae9', '0379e177-2a89-4df5-ba1a-f78d26e202e8', '25eb7203-3e61-46db-ae84-1057111d3062', '68f6e9dc-5738-4c3f-aea2-1042ac4d706f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Delete snapshot completed successfully. Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b8d8dd2-76b7-422c-a341-318ae6eea1ea tempest-CinderUnicodeTest-15122213 None] Lock "cinder-fc08f988-e414-4dfd-a8cb-dc41f82de5f7-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Acquiring lock "cinder-d3ac7394-d6b1-4313-a7d6-35958d32686c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Lock "cinder-d3ac7394-d6b1-4313-a7d6-35958d32686c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Acquiring lock "cinder-quobyte-d3ac7394-d6b1-4313-a7d6-35958d32686c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-d3ac7394-d6b1-4313-a7d6-35958d32686c" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c27217d-af14-4316-a96d-622022476025]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:46 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c Jul 17 05:38:46 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Creating offline snapshot a71553bb-34ed-4fb8-a8b6-4e23fa9d007e of volume 76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d8b5fe-546c-42a0-b5cf-fe5e47b1e9c5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:46 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:46 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c Jul 17 05:38:46 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:46 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 Jul 17 05:38:46 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:46 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-d3ac7394-d6b1-4313-a7d6-35958d32686c" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-d3ac7394-d6b1-4313-a7d6-35958d32686c" released by "delete_volume" :: held 0.755s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=141,cinder:INSERT=49,cinder:UPDATE=180,cinder:DELETE=18 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:38:46 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:46 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e 1G Jul 17 05:38:46 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Created reservations ['5b2f95d8-350f-48fa-a52f-63a7005af50e', 'aaae5357-8fa0-4223-86b6-71c0aa304d87', 'ec20d536-aa84-476a-b8ba-b6ed5cf50ba8', 'faa285a8-6851-4e21-8b53-5b0c8f5190c0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:47 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:47 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Acquiring lock "cinder-da52caa2-7107-42a5-b5bf-85bfe5fa6939-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Lock "cinder-da52caa2-7107-42a5-b5bf-85bfe5fa6939-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Acquiring lock "cinder-quobyte-da52caa2-7107-42a5-b5bf-85bfe5fa6939" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-da52caa2-7107-42a5-b5bf-85bfe5fa6939" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e6880d-8396-4968-938b-bd5fd5e9bfc7]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:47 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.325s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Deleted volume successfully. Jul 17 05:38:47 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e 1G" returned: 0 in 0.480s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3af5243b-250c-44c0-91e1-fabdf972205b tempest-CinderUnicodeTest-15122213 None] Lock "cinder-d3ac7394-d6b1-4313-a7d6-35958d32686c-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:47 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e Jul 17 05:38:47 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:47 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 Jul 17 05:38:47 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD, size 20.69 MB, duration 4.80 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:38:47 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Image download 20.69 MB at 4.31 MB/s Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc2c85f-491c-4aa2-9090-c2c3d70e44bf]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:47 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:47 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e is being set with open permissions: ugo+rw Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:47 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:47 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e Jul 17 05:38:47 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:47 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD Jul 17 05:38:47 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:47 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939 Jul 17 05:38:47 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:47 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:47 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Temporary image a059ad08-bba0-4fd0-9f21-091853694a3c is fetched for user 11089c2c80b448de855d8ba843f7d273. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:38:47 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-da52caa2-7107-42a5-b5bf-85bfe5fa6939" returned: 0 in 0.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Lock "cinder-quobyte-da52caa2-7107-42a5-b5bf-85bfe5fa6939" released by "delete_volume" :: held 0.709s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:47 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.info Jul 17 05:38:47 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c887b98f-c0e5-40e2-b3c8-39651b273187]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Created reservations ['3b1699c4-aee0-447a-99a2-25875632b9e2', '9058bac5-b05c-40e3-a17b-0d9d0d3de602', 'a6c754e1-a0cc-43b6-a113-7a10ade5c00c', 'd3d03d58-8143-4e3b-a50a-a942a88cd62f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:48 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD Jul 17 05:38:48 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:48 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:48 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:48 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.info" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:48 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.info is being set with open permissions: ugo+rw Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:48 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.info Jul 17 05:38:48 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:48 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:48 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Deleted volume successfully. Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e967594e-ecbe-48ec-b7fd-589791cebe27 tempest-CinderUnicodeTest-15122213 None] Lock "cinder-da52caa2-7107-42a5-b5bf-85bfe5fa6939-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:48 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.info" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1825526370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12af98de-d8f8-4996-8ca2-29f2778e6b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ab9b8c0eee4465afcfaa26355ae52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:42Z,use_quota=True,user_id='11089c2c80b448de855d8ba843f7d273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79abe84f-522f-4a5c-9358-236c77c39beb),volume_type_id=79abe84f-522f-4a5c-9358-236c77c39beb)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Creating volume 12af98de-d8f8-4996-8ca2-29f2778e6b1c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:48 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c 1073741824 Jul 17 05:38:48 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4c458c03-9d2c-4abb-abb6-896654ac248a tempest-VolumesSnapshotTestJSON-2114227263 None] Create snapshot completed successfully Jul 17 05:38:48 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c 1073741824" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:49 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c Jul 17 05:38:49 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:49 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Attempting download of a059ad08-bba0-4fd0-9f21-091853694a3c ((None, [{'url': 'file:///opt/stack/data/glance/images/a059ad08-bba0-4fd0-9f21-091853694a3c', 'metadata': {}}])) to volume 12af98de-d8f8-4996-8ca2-29f2778e6b1c. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116d970-dc18-4a77-913b-5b4567a19956]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a059ad08-bba0-4fd0-9f21-091853694a3c_5cb_bx9m {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:49 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a059ad08-bba0-4fd0-9f21-091853694a3c_5cb_bx9m Jul 17 05:38:49 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:49 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a059ad08-bba0-4fd0-9f21-091853694a3c_5cb_bx9m" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a059ad08-bba0-4fd0-9f21-091853694a3c_5cb_bx9m {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:49 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a059ad08-bba0-4fd0-9f21-091853694a3c_5cb_bx9m Jul 17 05:38:49 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:50 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a059ad08-bba0-4fd0-9f21-091853694a3c_5cb_bx9m" returned: 1 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a059ad08-bba0-4fd0-9f21-091853694a3c_5cb_bx9m' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f466331-695f-46cc-9798-0d79434ed43d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (0bafb033-6d8f-41df-ba36-03498535a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdf4e7f-fe82-4e13-8851-4961b22d8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:50 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdf4e7f-fe82-4e13-8851-4961b22d8785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1005087093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbaf163-a37d-46d4-b9e7-448aa1bec2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d82ec9ceedc43c695fc2ec6902355a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a71553bb-34ed-4fb8-a8b6-4e23fa9d007e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:38:50Z,use_quota=True,user_id='e3d293335fcc41dd8f33362baad05c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:50 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f525f8-9689-43f9-b844-0c3183c4c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f525f8-9689-43f9-b844-0c3183c4c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de8f716-b581-44cd-ba3d-5221ac40fd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de8f716-b581-44cd-ba3d-5221ac40fd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3fbaf163-a37d-46d4-b9e7-448aa1bec2c2', 'volume_name': 'volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2', 'volume_size': 1, 'snapshot_id': 'a71553bb-34ed-4fb8-a8b6-4e23fa9d007e'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f83b63-8a44-4016-8c3b-21f62c42f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f83b63-8a44-4016-8c3b-21f62c42f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02d7fd-099f-4e08-ab5b-9837494162a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume 3fbaf163-a37d-46d4-b9e7-448aa1bec2c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2', 'volume_size': 1, 'snapshot_id': 'a71553bb-34ed-4fb8-a8b6-4e23fa9d007e'} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Creating volume 3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 from snapshot a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] snapshot: a71553bb-34ed-4fb8-a8b6-4e23fa9d007e, volume: 3fbaf163-a37d-46d4-b9e7-448aa1bec2c2, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1451f8e-fa0b-4f65-b726-e1d7ccfd3954]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:50 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] a059ad08-bba0-4fd0-9f21-091853694a3c was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:50 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e Jul 17 05:38:50 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:50 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c Jul 17 05:38:50 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:50 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" returned: 0 in 0.423s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff12e665-c1b6-4696-a3b9-ca4d9e1d705c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:51 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 Jul 17 05:38:51 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:51 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" returned: 0 in 0.432s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:51 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:38:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:51 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 Jul 17 05:38:51 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:53 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c" returned: 0 in 2.878s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:53 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a059ad08-bba0-4fd0-9f21-091853694a3c_iqf2474qdevstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:38:53 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Converted 112.00 MB image at 38.89 MB/s Jul 17 05:38:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:53 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c 1G Jul 17 05:38:53 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:53 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c 1G" returned: 0 in 0.494s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:53 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Downloaded image a059ad08-bba0-4fd0-9f21-091853694a3c ((None, [{'url': 'file:///opt/stack/data/glance/images/a059ad08-bba0-4fd0-9f21-091853694a3c', 'metadata': {}}])) to volume 12af98de-d8f8-4996-8ca2-29f2778e6b1c successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:38:53 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Temporary image a059ad08-bba0-4fd0-9f21-091853694a3c for user 11089c2c80b448de855d8ba843f7d273 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:38:53 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Marking volume 12af98de-d8f8-4996-8ca2-29f2778e6b1c as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:38:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Copying metadata from image a059ad08-bba0-4fd0-9f21-091853694a3c to 12af98de-d8f8-4996-8ca2-29f2778e6b1c. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:38:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Creating volume glance metadata for volume 12af98de-d8f8-4996-8ca2-29f2778e6b1c backed by image a059ad08-bba0-4fd0-9f21-091853694a3c with: {'image_id': 'a059ad08-bba0-4fd0-9f21-091853694a3c', 'image_name': 'tempest-scenario-img--2005000880', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:38:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7e428c-53ba-440b-82f4-1866ca9f45d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c', 'volume_size': 1, 'image_id': 'a059ad08-bba0-4fd0-9f21-091853694a3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a059ad08-bba0-4fd0-9f21-091853694a3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2005000880', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09ab9b8c0eee4465afcfaa26355ae52a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a059ad08-bba0-4fd0-9f21-091853694a3c', 'created_at': datetime.datetime(2026, 7, 17, 3, 38, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 38, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a059ad08-bba0-4fd0-9f21-091853694a3c/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7c0d8-dfb3-4e8d-a27b-75c9a83b54f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Volume volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c (12af98de-d8f8-4996-8ca2-29f2778e6b1c): created successfully Jul 17 05:38:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7c0d8-dfb3-4e8d-a27b-75c9a83b54f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Flow 'volume_create_manager' (bb1c4738-f1b1-404d-a289-276c59bb98f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b3a5cbaf-48b7-44e7-b32c-11612a55a046 tempest-TestInstancesWithCinderVolumes-1644132374 None] Created volume successfully. Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:56 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:56 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:56 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" returned: 0 in 5.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea85ce4-0064-4cc3-ae7a-6e4097e0f8b5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:56 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.388s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:38:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:38:56 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 Jul 17 05:38:56 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:57 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" returned: 0 in 0.623s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:38:57 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Converted 1024.00 MB image at 190.88 MB/s Jul 17 05:38:57 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 is being set with open permissions: ugo+rw Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:57 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 Jul 17 05:38:57 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:57 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" released by "_copy_volume_from_snapshot" :: held 7.217s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" released by "_create_volume_from_snapshot" :: held 7.251s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.271s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02d7fd-099f-4e08-ab5b-9837494162a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2', 'volume_size': 1, 'snapshot_id': 'a71553bb-34ed-4fb8-a8b6-4e23fa9d007e'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f485b923-699a-451d-af0a-d190ea2b0eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:38:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Volume volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 (3fbaf163-a37d-46d4-b9e7-448aa1bec2c2): created successfully Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f485b923-699a-451d-af0a-d190ea2b0eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:38:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Flow 'volume_create_manager' (0bafb033-6d8f-41df-ba36-03498535a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:38:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-42235f31-466c-4356-a54d-f14e3d917e73 tempest-VolumesSnapshotTestJSON-2114227263 None] Created volume successfully. Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab24657-fc79-43ff-aac0-38fb76f1a62a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:58 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 Jul 17 05:38:58 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:58 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:58 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2 Jul 17 05:38:58 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:58 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2" released by "delete_volume" :: held 0.733s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['8dcc9954-0c99-44ce-90de-e8c022af0071', 'be27b132-ba4d-4f7c-99a0-1e7f4d197d38', '8f86dc47-ec8a-403d-b244-0bb1c5476c67', '74f50d6c-c2ef-4ebb-a3f4-60c19c6b2f65'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:59 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:38:59 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-c567ccfc-e4fe-434f-ac2a-96f42ab723dd req-2be45f84-b456-4827-b99d-3094bafdede5 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-c567ccfc-e4fe-434f-ac2a-96f42ab723dd req-2be45f84-b456-4827-b99d-3094bafdede5 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-c567ccfc-e4fe-434f-ac2a-96f42ab723dd req-2be45f84-b456-4827-b99d-3094bafdede5 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-c567ccfc-e4fe-434f-ac2a-96f42ab723dd req-2be45f84-b456-4827-b99d-3094bafdede5 tempest-TestInstancesWithCinderVolumes-1644132374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2646664a-adfc-47ba-b879-319fc2ffe0b3', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:59 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:38:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Deleted volume successfully. Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Deleting offline snapshot a71553bb-34ed-4fb8-a8b6-4e23fa9d007e of volume 76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] snapshot_file for this snap is: volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:38:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-c567ccfc-e4fe-434f-ac2a-96f42ab723dd req-2be45f84-b456-4827-b99d-3094bafdede5 tempest-TestInstancesWithCinderVolumes-1644132374 None] attachment_update completed successfully. Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b9042-1400-4c9e-b5c1-a098038ebb60]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:38:59 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e Jul 17 05:38:59 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5b1f407c-e5d4-4121-9b10-f6ebc27f208e tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-3fbaf163-a37d-46d4-b9e7-448aa1bec2c2-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:38:59 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" returned: 0 in 0.454s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1dc142-945f-4efb-a245-b505127f17da]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:38:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:00 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 Jul 17 05:39:00 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:00 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" returned: 0 in 0.405s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:00 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e Jul 17 05:39:00 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:00 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" returned: 0 in 0.352s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:00 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e Jul 17 05:39:00 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:00 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505.a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e" released by "_delete_snapshot" :: held 1.590s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" released by "delete_snapshot" :: held 1.629s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['485a7fac-1a4c-4e99-bcd1-99bfe47fb79f', '828b3622-2cec-449f-a7d0-29cd314f8167', 'd3256bfd-1394-4d15-9b31-0b877dcf81bd', 'bd9e26ec-cf74-4abf-b40f-5e69eaf9f6e9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:39:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Delete snapshot completed successfully. Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4ef4b9b-02c5-4385-be19-8a1989738dea tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-a71553bb-34ed-4fb8-a8b6-4e23fa9d007e-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-76b7997d-99c5-4b6f-bdd3-dc457d7c6505-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-76b7997d-99c5-4b6f-bdd3-dc457d7c6505-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0ead30-3d47-422a-97fd-f36f74d73a5a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:39:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:01 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 Jul 17 05:39:01 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:02 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" returned: 0 in 0.546s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:02 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505 Jul 17 05:39:02 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:02 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" returned: 0 in 0.429s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-76b7997d-99c5-4b6f-bdd3-dc457d7c6505" released by "delete_volume" :: held 1.099s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['6097631f-c933-4ab2-978b-b933ce332247', '6be3c93b-acfa-4d3a-8da5-637be65229b0', '441dcf6b-c0d1-41c9-9eab-dfccefbc402c', 'f0281fab-62b5-400e-ab1f-9f60384858a0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:02 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:39:02 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:03 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:03 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:39:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Deleted volume successfully. Jul 17 05:39:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-32d9f094-fee1-4d63-8377-66c3f42f67da tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-76b7997d-99c5-4b6f-bdd3-dc457d7c6505-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-07996c93-f033-4245-bee7-83e601270e97-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-07996c93-f033-4245-bee7-83e601270e97-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "cinder-quobyte-07996c93-f033-4245-bee7-83e601270e97" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-07996c93-f033-4245-bee7-83e601270e97" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faf8c08-0b65-4259-a561-fede28f7fae7]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:04 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 Jul 17 05:39:04 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:04 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97" returned: 0 in 0.421s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:04 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97 Jul 17 05:39:04 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:04 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-07996c93-f033-4245-bee7-83e601270e97" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-quobyte-07996c93-f033-4245-bee7-83e601270e97" released by "delete_volume" :: held 0.777s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Created reservations ['3955ac02-d9fe-42dc-a5e5-ad868fc7d260', '37824cb7-d7f3-4da3-929a-a6cfb2646422', '4dfdec61-a159-48f8-8ca9-e35d42b051f8', '577e46d1-962a-4c6f-97d7-970372ad4cfa'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:04 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:39:04 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:05 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:39:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Deleted volume successfully. Jul 17 05:39:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2f1f1e0f-7c69-4d96-bedd-9c3f41cf9d09 tempest-VolumesSnapshotTestJSON-2114227263 None] Lock "cinder-07996c93-f033-4245-bee7-83e601270e97-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:13 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=139,cinder:INSERT=40,cinder:UPDATE=147,cinder:DELETE=10 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:39:23 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=51,cinder:SELECT=43,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:39:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-85827f76-3aea-4693-aea8-768b59ac1255 req-1d8b7447-4347-495e-9582-f8ee5a45dcd2 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-85827f76-3aea-4693-aea8-768b59ac1255 req-1d8b7447-4347-495e-9582-f8ee5a45dcd2 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-85827f76-3aea-4693-aea8-768b59ac1255 req-1d8b7447-4347-495e-9582-f8ee5a45dcd2 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-85827f76-3aea-4693-aea8-768b59ac1255 req-1d8b7447-4347-495e-9582-f8ee5a45dcd2 tempest-TestInstancesWithCinderVolumes-1644132374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-605d16f4-e915-4a9d-8706-6bf836fabc08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed158e1b-68fa-4a71-a159-1ba7d56712c7', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:39:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-85827f76-3aea-4693-aea8-768b59ac1255 req-1d8b7447-4347-495e-9582-f8ee5a45dcd2 tempest-TestInstancesWithCinderVolumes-1644132374 None] attachment_update completed successfully. Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Flow 'volume_create_manager' (988e5a9c-4d17-4504-b544-303e2a9456be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957d3aa7-72f3-4217-a19e-20bf738d466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957d3aa7-72f3-4217-a19e-20bf738d466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1121355317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9827beb7-7003-48bf-b30b-66682897ee51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d689c72da54ea7b21e023fc043a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:39:32Z,use_quota=True,user_id='c984d0c148134255b35fc1cbb17ca25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe25bd8-664c-45d4-a433-1d2c1531a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe25bd8-664c-45d4-a433-1d2c1531a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501da52a-965b-4155-b0b1-e44127fb78d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501da52a-965b-4155-b0b1-e44127fb78d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9827beb7-7003-48bf-b30b-66682897ee51', 'volume_name': 'volume-9827beb7-7003-48bf-b30b-66682897ee51', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cae525-3761-4000-b00d-e4e6d5684769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cae525-3761-4000-b00d-e4e6d5684769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fa6d2f-9447-4306-bed8-df56b6c1ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:39:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Volume 9827beb7-7003-48bf-b30b-66682897ee51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9827beb7-7003-48bf-b30b-66682897ee51', 'volume_size': 1} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1121355317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9827beb7-7003-48bf-b30b-66682897ee51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d689c72da54ea7b21e023fc043a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:39:32Z,use_quota=True,user_id='c984d0c148134255b35fc1cbb17ca25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Creating volume 9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:39:32 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:39:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:32 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 1073741824 Jul 17 05:39:32 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:33 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 1073741824" returned: 0 in 0.525s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:33 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 Jul 17 05:39:33 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:33 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51" returned: 0 in 0.305s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fa6d2f-9447-4306-bed8-df56b6c1ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9827beb7-7003-48bf-b30b-66682897ee51', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a72a0-e839-4ce6-8985-981cacd77f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:39:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Volume volume-9827beb7-7003-48bf-b30b-66682897ee51 (9827beb7-7003-48bf-b30b-66682897ee51): created successfully Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a72a0-e839-4ce6-8985-981cacd77f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Flow 'volume_create_manager' (988e5a9c-4d17-4504-b544-303e2a9456be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-cd519016-41a6-46ea-8c1c-83de4e0cd4d0 req-21b6bbbc-0aae-4cdf-bdc1-440d3ab6d616 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-cd519016-41a6-46ea-8c1c-83de4e0cd4d0 req-21b6bbbc-0aae-4cdf-bdc1-440d3ab6d616 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-34beee6a-ad9b-40b2-8832-b2affa112ef1 tempest-TestStampPattern-1524560404 None] Created volume successfully. Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-cd519016-41a6-46ea-8c1c-83de4e0cd4d0 req-21b6bbbc-0aae-4cdf-bdc1-440d3ab6d616 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-cd519016-41a6-46ea-8c1c-83de4e0cd4d0 req-21b6bbbc-0aae-4cdf-bdc1-440d3ab6d616 tempest-TestInstancesWithCinderVolumes-1644132374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-79c3708e-93c3-4da9-abda-d94283ba4c71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e394c3da-f4cc-4c12-bbf1-b784811ce311', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:39:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-cd519016-41a6-46ea-8c1c-83de4e0cd4d0 req-21b6bbbc-0aae-4cdf-bdc1-440d3ab6d616 tempest-TestInstancesWithCinderVolumes-1644132374 None] attachment_update completed successfully. Jul 17 05:39:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-bae9ec74-bec0-43c4-b82c-1fa0859bf8cd req-e62967ac-739b-4e42-8a7f-b20ba79f0cdc tempest-TestInstancesWithCinderVolumes-1644132374 None] Terminate volume connection completed successfully. Jul 17 05:39:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bae9ec74-bec0-43c4-b82c-1fa0859bf8cd req-e62967ac-739b-4e42-8a7f-b20ba79f0cdc tempest-TestInstancesWithCinderVolumes-1644132374 None] Deleting attachment ed158e1b-68fa-4a71-a159-1ba7d56712c7. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:39:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "cinder-605d16f4-e915-4a9d-8706-6bf836fabc08-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-605d16f4-e915-4a9d-8706-6bf836fabc08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "cinder-quobyte-605d16f4-e915-4a9d-8706-6bf836fabc08" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-quobyte-605d16f4-e915-4a9d-8706-6bf836fabc08" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6c9caf-73b1-42f6-ba78-9b32f81108a1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:39:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:40 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 Jul 17 05:39:40 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:40 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08" returned: 0 in 0.475s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:40 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08 Jul 17 05:39:40 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:40 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-605d16f4-e915-4a9d-8706-6bf836fabc08" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-quobyte-605d16f4-e915-4a9d-8706-6bf836fabc08" released by "delete_volume" :: held 0.848s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:40 devstack cinder-volume[87750]: WARNING cinder.quota [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-564862873-1513738815 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-564862873-1513738815, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:39:40 devstack cinder-volume[87750]: WARNING cinder.quota [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-564862873-1513738815 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-564862873-1513738815, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Created reservations ['2a0c121b-55e7-491e-a5ea-8fdf50c9c222', 'd1d0e368-8c41-4229-bf3f-63d3818d1a33', 'a1dddc16-48df-4d0f-a141-a158ae5f75f7', 'a9706fd4-f3c9-4409-a3b9-21add3cfcabd'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:40 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:39:40 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:41 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:41 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:39:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Deleted volume successfully. Jul 17 05:39:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb2aacf3-77d1-48c3-8805-2fb5a43ab78a tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-605d16f4-e915-4a9d-8706-6bf836fabc08-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-8a15d6ed-66a9-4d45-90c3-3b6537f37f5a req-95ab3740-7923-4f1c-8380-c687251833c6 tempest-TestInstancesWithCinderVolumes-1644132374 None] Terminate volume connection completed successfully. Jul 17 05:39:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-8a15d6ed-66a9-4d45-90c3-3b6537f37f5a req-95ab3740-7923-4f1c-8380-c687251833c6 tempest-TestInstancesWithCinderVolumes-1644132374 None] Deleting attachment e394c3da-f4cc-4c12-bbf1-b784811ce311. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:39:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "cinder-79c3708e-93c3-4da9-abda-d94283ba4c71-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-79c3708e-93c3-4da9-abda-d94283ba4c71-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "cinder-quobyte-79c3708e-93c3-4da9-abda-d94283ba4c71" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-quobyte-79c3708e-93c3-4da9-abda-d94283ba4c71" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f74f18-c5b4-44b8-86ee-18ffd616561d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:45 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 Jul 17 05:39:45 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:45 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:45 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71 Jul 17 05:39:45 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:45 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-79c3708e-93c3-4da9-abda-d94283ba4c71" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-quobyte-79c3708e-93c3-4da9-abda-d94283ba4c71" released by "delete_volume" :: held 0.736s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:45 devstack cinder-volume[87750]: WARNING cinder.quota [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101119801-519949201 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101119801-519949201, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:39:45 devstack cinder-volume[87750]: WARNING cinder.quota [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101119801-519949201 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1101119801-519949201, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Created reservations ['5ca15fe8-12b7-47ff-8157-7709ffefced1', '17f25c60-faf9-4ca2-bd0e-bdfb01f8c40e', '9c0afb4b-5917-42a9-a354-72ecaf2782b2', 'd96c5855-dbfc-4fd5-b8f2-ec318eeeb1d9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:45 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:39:45 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:46 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.320s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:46 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:39:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Deleted volume successfully. Jul 17 05:39:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dfe72194-1d9d-47c4-b7f2-3cf52bcf0b95 tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-79c3708e-93c3-4da9-abda-d94283ba4c71-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3d3ded1b-953c-4ad7-a320-f996385e9848 req-52bc51d9-cf61-4cca-bff3-8fbd5543d7a3 tempest-TestInstancesWithCinderVolumes-1644132374 None] Terminate volume connection completed successfully. Jul 17 05:39:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3d3ded1b-953c-4ad7-a320-f996385e9848 req-52bc51d9-cf61-4cca-bff3-8fbd5543d7a3 tempest-TestInstancesWithCinderVolumes-1644132374 None] Deleting attachment 2646664a-adfc-47ba-b879-319fc2ffe0b3. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "cinder-12af98de-d8f8-4996-8ca2-29f2778e6b1c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-12af98de-d8f8-4996-8ca2-29f2778e6b1c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "cinder-quobyte-12af98de-d8f8-4996-8ca2-29f2778e6b1c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-quobyte-12af98de-d8f8-4996-8ca2-29f2778e6b1c" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd7c2e-0d8a-47e3-b2fc-872d0a2bbf11]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:50 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c Jul 17 05:39:50 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:50 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c" returned: 0 in 0.379s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:50 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c Jul 17 05:39:50 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:51 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12af98de-d8f8-4996-8ca2-29f2778e6b1c" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-quobyte-12af98de-d8f8-4996-8ca2-29f2778e6b1c" released by "delete_volume" :: held 0.684s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:51 devstack cinder-volume[87750]: WARNING cinder.quota [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528856803-1879402982 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528856803-1879402982, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:39:51 devstack cinder-volume[87750]: WARNING cinder.quota [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528856803-1879402982 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-528856803-1879402982, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Created reservations ['ea1f372c-985c-4919-8396-78251b66721e', 'ea1a3885-bd3e-4a4c-aa0b-ac0140052e43', '28deb69c-c859-4799-a4f7-49075ad0332d', 'ab7af006-faed-4bc8-9e2b-22d738b09b6f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:51 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:39:51 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:51 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:39:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Deleted volume successfully. Jul 17 05:39:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ccbe5f65-43cb-4dcc-aab6-42c265930eab tempest-TestInstancesWithCinderVolumes-1644132374 None] Lock "cinder-12af98de-d8f8-4996-8ca2-29f2778e6b1c-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:39:56 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:39:56 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:39:56 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:39:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:40:01 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=29,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:40:01 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=37,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:40:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-86077bea-e705-4610-9e14-bfdd407bc56a req-c75d91d7-7ee8-47cc-8a80-59911389d2c8 tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-86077bea-e705-4610-9e14-bfdd407bc56a req-c75d91d7-7ee8-47cc-8a80-59911389d2c8 tempest-TestStampPattern-1524560404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-86077bea-e705-4610-9e14-bfdd407bc56a req-c75d91d7-7ee8-47cc-8a80-59911389d2c8 tempest-TestStampPattern-1524560404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-86077bea-e705-4610-9e14-bfdd407bc56a req-c75d91d7-7ee8-47cc-8a80-59911389d2c8 tempest-TestStampPattern-1524560404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-9827beb7-7003-48bf-b30b-66682897ee51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d9cc396-62ce-4a15-9e50-959fbe940f76', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:40:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-86077bea-e705-4610-9e14-bfdd407bc56a req-c75d91d7-7ee8-47cc-8a80-59911389d2c8 tempest-TestStampPattern-1524560404 None] attachment_update completed successfully. Jul 17 05:40:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-04982f43-b957-4bf5-8255-9e98dc39e84e req-7a078d6e-aa6e-4e05-bfa1-669fdb1f315e tempest-TestStampPattern-1524560404 None] Terminate volume connection completed successfully. Jul 17 05:40:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-04982f43-b957-4bf5-8255-9e98dc39e84e req-7a078d6e-aa6e-4e05-bfa1-669fdb1f315e tempest-TestStampPattern-1524560404 None] Deleting attachment 0d9cc396-62ce-4a15-9e50-959fbe940f76. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Creating offline snapshot b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 of volume 9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2339bb7-1c24-46a2-951e-392dc5687016]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:10 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 Jul 17 05:40:10 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:10 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:10 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 1G Jul 17 05:40:10 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:10 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 1G" returned: 0 in 0.439s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9827beb7-7003-48bf-b30b-66682897ee51 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:10 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9827beb7-7003-48bf-b30b-66682897ee51 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 Jul 17 05:40:10 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:11 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9827beb7-7003-48bf-b30b-66682897ee51 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" returned: 0 in 0.358s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 is being set with open permissions: ugo+rw Jul 17 05:40:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:11 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 Jul 17 05:40:11 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:11 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:11 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.info Jul 17 05:40:11 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:11 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.info" returned: 0 in 0.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.info is being set with open permissions: ugo+rw Jul 17 05:40:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:11 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.info Jul 17 05:40:11 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:12 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.info" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6403f322-cb75-4e34-9b1d-84a95dc96dbb tempest-TestStampPattern-1524560404 None] Create snapshot completed successfully Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Flow 'volume_create_manager' (0d0129af-adcc-4845-b999-a546750070bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f9a907-91c0-4933-bd38-6e9ae6117a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f9a907-91c0-4933-bd38-6e9ae6117a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1602916073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0fddd3-ba1d-43d8-9014-b480bfd43827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d689c72da54ea7b21e023fc043a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:40:20Z,use_quota=True,user_id='c984d0c148134255b35fc1cbb17ca25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e2413f-67ee-4712-af08-d7db3144e1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e2413f-67ee-4712-af08-d7db3144e1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c33c5e-0ee6-464e-8752-717b5021f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c33c5e-0ee6-464e-8752-717b5021f03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e0fddd3-ba1d-43d8-9014-b480bfd43827', 'volume_name': 'volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827', 'volume_size': 1, 'snapshot_id': 'b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f330090e-6b83-4e3d-afad-94eb7ba5067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f330090e-6b83-4e3d-afad-94eb7ba5067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e302af-8d2a-4657-a1c8-216911f52b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Volume 0e0fddd3-ba1d-43d8-9014-b480bfd43827: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827', 'volume_size': 1, 'snapshot_id': 'b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49'} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-quobyte-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49-0e0fddd3-ba1d-43d8-9014-b480bfd43827" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49-0e0fddd3-ba1d-43d8-9014-b480bfd43827" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Creating volume 0e0fddd3-ba1d-43d8-9014-b480bfd43827 from snapshot b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-quobyte-0e0fddd3-ba1d-43d8-9014-b480bfd43827" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-0e0fddd3-ba1d-43d8-9014-b480bfd43827" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] snapshot: b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49, volume: 0e0fddd3-ba1d-43d8-9014-b480bfd43827, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b44174-eafe-41ba-bfd1-60852d8459a4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:20 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 Jul 17 05:40:20 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:20 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9827beb7-7003-48bf-b30b-66682897ee51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cf2727-6337-4e7e-a6c4-b4ea75a58da0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:20 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 Jul 17 05:40:20 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:21 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51" returned: 0 in 0.479s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:21 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:40:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:21 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 Jul 17 05:40:21 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:27 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827" returned: 0 in 6.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2c5d70-7159-47aa-80f9-2d174ff9c877]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:27 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 Jul 17 05:40:27 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:28 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51" returned: 0 in 0.740s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:40:28 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Converted 1024.00 MB image at 164.26 MB/s Jul 17 05:40:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 is being set with open permissions: ugo+rw Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:28 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 Jul 17 05:40:28 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:28 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-0e0fddd3-ba1d-43d8-9014-b480bfd43827" released by "_copy_volume_from_snapshot" :: held 8.377s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49-0e0fddd3-ba1d-43d8-9014-b480bfd43827" released by "_create_volume_from_snapshot" :: held 8.422s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.448s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Flow 'volume_create_manager' (872d4db9-aef2-4878-ab2b-0ed57c00bf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65455942-8fb1-4994-b373-53313345846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65455942-8fb1-4994-b373-53313345846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-616876390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12abc984-dc0f-423e-9ef1-d3213e9f1873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8d20a6364d4c288233d20d40acfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:40:29Z,use_quota=True,user_id='f8526ea23cdf4952ba9945164e415ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249613af-1ca7-42db-8a87-c831ef564cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249613af-1ca7-42db-8a87-c831ef564cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383be66-1c5d-475c-b63c-44bb2c9ff297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e302af-8d2a-4657-a1c8-216911f52b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827', 'volume_size': 1, 'snapshot_id': 'b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dce0f47-d61b-4e6b-a9af-2e25e3c62dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Volume volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 (0e0fddd3-ba1d-43d8-9014-b480bfd43827): created successfully Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dce0f47-d61b-4e6b-a9af-2e25e3c62dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Flow 'volume_create_manager' (0d0129af-adcc-4845-b999-a546750070bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:40:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eba42957-d65b-4b41-a53e-c98b4ff2f4f4 tempest-TestStampPattern-1524560404 None] Created volume successfully. Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383be66-1c5d-475c-b63c-44bb2c9ff297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12abc984-dc0f-423e-9ef1-d3213e9f1873', 'volume_name': 'volume-12abc984-dc0f-423e-9ef1-d3213e9f1873', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954dcbd8-ba8b-4048-9d11-c8d19022c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954dcbd8-ba8b-4048-9d11-c8d19022c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc9dcf0-5879-4e33-a058-430f563abac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Volume 12abc984-dc0f-423e-9ef1-d3213e9f1873: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12abc984-dc0f-423e-9ef1-d3213e9f1873', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Trying to clone 12abc984-dc0f-423e-9ef1-d3213e9f1873 from image 574080f6-40fa-4386-bd5c-892273b66d56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:40:29 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Image download 20.69 MB at 20.69 MB/s Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32b8a50-45c0-4b67-a20f-26d0e6a4e4dd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:29 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD Jul 17 05:40:29 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:30 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 is fetched for user f8526ea23cdf4952ba9945164e415ae2. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e941f-37e9-402a-990a-13d34dda603b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:30 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD Jul 17 05:40:30 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:30 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-616876390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12abc984-dc0f-423e-9ef1-d3213e9f1873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8d20a6364d4c288233d20d40acfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:40:29Z,use_quota=True,user_id='f8526ea23cdf4952ba9945164e415ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Creating volume 12abc984-dc0f-423e-9ef1-d3213e9f1873 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:40:30 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:40:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:30 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 1073741824 Jul 17 05:40:30 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:31 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 1073741824" returned: 0 in 0.456s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:31 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 Jul 17 05:40:31 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:31 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873" returned: 0 in 0.421s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Attempting download of 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume 12abc984-dc0f-423e-9ef1-d3213e9f1873. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b872f7-ab74-429d-a9b8-215eda7fb0b4]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_8jgizo5j {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:31 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_8jgizo5j Jul 17 05:40:31 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:32 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_8jgizo5j" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_8jgizo5j {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:32 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_8jgizo5j Jul 17 05:40:32 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:32 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_8jgizo5j" returned: 1 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574080f6-40fa-4386-bd5c-892273b66d56_8jgizo5j' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[306c3393-d656-40f1-a64e-d06fd997a391]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:32 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD Jul 17 05:40:32 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:32 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] 574080f6-40fa-4386-bd5c-892273b66d56 was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:40:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:32 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 Jul 17 05:40:32 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:34 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873" returned: 0 in 1.989s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:34 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574080f6-40fa-4386-bd5c-892273b66d56_sih2drn3devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:40:34 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Converted 112.00 MB image at 56.28 MB/s Jul 17 05:40:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:34 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 1G Jul 17 05:40:34 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:35 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 1G" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Downloaded image 574080f6-40fa-4386-bd5c-892273b66d56 ((None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}])) to volume 12abc984-dc0f-423e-9ef1-d3213e9f1873 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Temporary image 574080f6-40fa-4386-bd5c-892273b66d56 for user f8526ea23cdf4952ba9945164e415ae2 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Marking volume 12abc984-dc0f-423e-9ef1-d3213e9f1873 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Copying metadata from image 574080f6-40fa-4386-bd5c-892273b66d56 to 12abc984-dc0f-423e-9ef1-d3213e9f1873. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Creating volume glance metadata for volume 12abc984-dc0f-423e-9ef1-d3213e9f1873 backed by image 574080f6-40fa-4386-bd5c-892273b66d56 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc9dcf0-5879-4e33-a058-430f563abac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12abc984-dc0f-423e-9ef1-d3213e9f1873', 'volume_size': 1, 'image_id': '574080f6-40fa-4386-bd5c-892273b66d56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574080f6-40fa-4386-bd5c-892273b66d56', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a8b56fc2c204a95b9bfe72d582d3be9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '574080f6-40fa-4386-bd5c-892273b66d56', 'created_at': datetime.datetime(2026, 7, 17, 3, 20, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 20, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574080f6-40fa-4386-bd5c-892273b66d56/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31cea3d-7577-4e2c-93e0-e96a47715492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:40:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Volume volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 (12abc984-dc0f-423e-9ef1-d3213e9f1873): created successfully Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31cea3d-7577-4e2c-93e0-e96a47715492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:40:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Flow 'volume_create_manager' (872d4db9-aef2-4878-ab2b-0ed57c00bf28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:40:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e7de6c30-921b-476a-8ed2-c49f1b7137e8 tempest-TestShelveInstance-1359867918 None] Created volume successfully. Jul 17 05:40:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-f43e1813-76e2-4f66-a052-d9c2552c5a36 req-e23f929f-45e0-480a-bb20-76c54ee4ca5c tempest-TestShelveInstance-1359867918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-f43e1813-76e2-4f66-a052-d9c2552c5a36 req-e23f929f-45e0-480a-bb20-76c54ee4ca5c tempest-TestShelveInstance-1359867918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-f43e1813-76e2-4f66-a052-d9c2552c5a36 req-e23f929f-45e0-480a-bb20-76c54ee4ca5c tempest-TestShelveInstance-1359867918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-f43e1813-76e2-4f66-a052-d9c2552c5a36 req-e23f929f-45e0-480a-bb20-76c54ee4ca5c tempest-TestShelveInstance-1359867918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-12abc984-dc0f-423e-9ef1-d3213e9f1873', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '764a95d3-b300-495d-9163-91b762716b6a', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:40:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-f43e1813-76e2-4f66-a052-d9c2552c5a36 req-e23f929f-45e0-480a-bb20-76c54ee4ca5c tempest-TestShelveInstance-1359867918 None] attachment_update completed successfully. Jul 17 05:40:49 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=29,cinder:UPDATE=9,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:40:49 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=30,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:40:56 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:40:56 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:40:56 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.291s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:40:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:41:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-2e72f9b9-4a3f-4f24-ab96-bcf7ee38a55a req-f0452262-e3e4-4db9-94d9-697ae8aa721b tempest-TestShelveInstance-1359867918 None] Terminate volume connection completed successfully. Jul 17 05:41:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-2e72f9b9-4a3f-4f24-ab96-bcf7ee38a55a req-f0452262-e3e4-4db9-94d9-697ae8aa721b tempest-TestShelveInstance-1359867918 None] Deleting attachment 764a95d3-b300-495d-9163-91b762716b6a. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:41:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-68573db0-acb1-42f0-9914-19ba8c5f2288 req-1fbf171a-de54-46a7-a967-0535e819b73f tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-68573db0-acb1-42f0-9914-19ba8c5f2288 req-1fbf171a-de54-46a7-a967-0535e819b73f tempest-TestStampPattern-1524560404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[397328cc-2b43-44ea-af27-7d524589f60d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-68573db0-acb1-42f0-9914-19ba8c5f2288 req-1fbf171a-de54-46a7-a967-0535e819b73f tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:12 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 Jul 17 05:41:12 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:13 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-68573db0-acb1-42f0-9914-19ba8c5f2288 req-1fbf171a-de54-46a7-a967-0535e819b73f tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827" returned: 0 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-68573db0-acb1-42f0-9914-19ba8c5f2288 req-1fbf171a-de54-46a7-a967-0535e819b73f tempest-TestStampPattern-1524560404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.402s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-68573db0-acb1-42f0-9914-19ba8c5f2288 req-1fbf171a-de54-46a7-a967-0535e819b73f tempest-TestStampPattern-1524560404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4122014e-8950-467a-b9fc-36c851b530ff', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:41:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-68573db0-acb1-42f0-9914-19ba8c5f2288 req-1fbf171a-de54-46a7-a967-0535e819b73f tempest-TestStampPattern-1524560404 None] attachment_update completed successfully. Jul 17 05:41:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7efa6d94-0922-4cd7-9657-7492b8e23b64 req-0ad709cc-3a11-463b-8f2e-052646a7d4b7 tempest-TestShelveInstance-1359867918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7efa6d94-0922-4cd7-9657-7492b8e23b64 req-0ad709cc-3a11-463b-8f2e-052646a7d4b7 tempest-TestShelveInstance-1359867918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-7efa6d94-0922-4cd7-9657-7492b8e23b64 req-0ad709cc-3a11-463b-8f2e-052646a7d4b7 tempest-TestShelveInstance-1359867918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-7efa6d94-0922-4cd7-9657-7492b8e23b64 req-0ad709cc-3a11-463b-8f2e-052646a7d4b7 tempest-TestShelveInstance-1359867918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041', 'name': 'volume-12abc984-dc0f-423e-9ef1-d3213e9f1873', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77dcd2d1-55cc-4049-aacd-07453bd34b63', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 05:41:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-7efa6d94-0922-4cd7-9657-7492b8e23b64 req-0ad709cc-3a11-463b-8f2e-052646a7d4b7 tempest-TestShelveInstance-1359867918 None] attachment_update completed successfully. Jul 17 05:41:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3588c841-25f6-47ad-b912-cc13518a56ec req-48ab39e3-d60f-476c-9e07-f7dd21c78778 tempest-TestStampPattern-1524560404 None] Terminate volume connection completed successfully. Jul 17 05:41:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3588c841-25f6-47ad-b912-cc13518a56ec req-48ab39e3-d60f-476c-9e07-f7dd21c78778 tempest-TestStampPattern-1524560404 None] Deleting attachment 4122014e-8950-467a-b9fc-36c851b530ff. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-0e0fddd3-ba1d-43d8-9014-b480bfd43827-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Lock "cinder-0e0fddd3-ba1d-43d8-9014-b480bfd43827-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-quobyte-0e0fddd3-ba1d-43d8-9014-b480bfd43827" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-0e0fddd3-ba1d-43d8-9014-b480bfd43827" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5786f9-d5a3-4257-b6a2-bcfc20c97cb3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:21 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 Jul 17 05:41:21 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:21 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:21 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827 Jul 17 05:41:21 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:21 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-0e0fddd3-ba1d-43d8-9014-b480bfd43827" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-0e0fddd3-ba1d-43d8-9014-b480bfd43827" released by "delete_volume" :: held 0.717s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Created reservations ['142336ed-75ef-4531-8c11-f26cd7574bcb', '93b60f5c-5c84-493a-8576-397903337ece', 'eaf45d4a-1771-45ec-a93a-bf5e49077275', 'd903bed2-3c4f-4f36-9f61-99923d866a7f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:22 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:22 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:22 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Deleted volume successfully. Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-11c86bee-b65e-4031-8c15-261da629789b tempest-TestStampPattern-1524560404 None] Lock "cinder-0e0fddd3-ba1d-43d8-9014-b480bfd43827-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Lock "cinder-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-quobyte-9827beb7-7003-48bf-b30b-66682897ee51" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-9827beb7-7003-48bf-b30b-66682897ee51" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-quobyte-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Deleting offline snapshot b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 of volume 9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] snapshot_file for this snap is: volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ad306-06f0-460c-8fb0-5a78e57e18dd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:22 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 Jul 17 05:41:22 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:23 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" returned: 0 in 0.375s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9827beb7-7003-48bf-b30b-66682897ee51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[28902a00-2786-46c7-a5f9-45ce63337d9d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:23 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 Jul 17 05:41:23 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:23 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:23 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 Jul 17 05:41:23 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:23 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:23 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49 Jul 17 05:41:23 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:24 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51.b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" returned: 0 in 0.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49" released by "_delete_snapshot" :: held 1.504s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-9827beb7-7003-48bf-b30b-66682897ee51" released by "delete_snapshot" :: held 1.536s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Created reservations ['ba037cf2-5a7d-48f3-95ac-a05e915cd482', 'd3bb4229-b973-4945-be1a-dcd589592ee6', 'a8478359-ce42-4f53-ad0f-e806c77175eb', '9bd33b74-d5b7-4991-b485-fbe0a3f1a0ba'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Delete snapshot completed successfully. Jul 17 05:41:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd33d11f-c759-42ec-ad13-9488b9df14d7 tempest-TestStampPattern-1524560404 None] Lock "cinder-b5ff7b3b-d814-44a6-9e75-a6c0df7f4b49-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-9827beb7-7003-48bf-b30b-66682897ee51-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Lock "cinder-9827beb7-7003-48bf-b30b-66682897ee51-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Acquiring lock "cinder-quobyte-9827beb7-7003-48bf-b30b-66682897ee51" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-9827beb7-7003-48bf-b30b-66682897ee51" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a92493a-48d9-4e73-b51e-d9cf88a01587]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:28 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 Jul 17 05:41:28 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:28 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:28 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51 Jul 17 05:41:29 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:29 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9827beb7-7003-48bf-b30b-66682897ee51" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Lock "cinder-quobyte-9827beb7-7003-48bf-b30b-66682897ee51" released by "delete_volume" :: held 0.681s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Created reservations ['4f4f2866-cbae-4fc7-83cd-e0b8d4fbacaa', 'ea8041d8-c469-4779-85f2-6412d85d883d', 'e19f4e14-764b-454f-a920-5eb7e86fc177', '318546fd-e530-425c-987a-129729581e59'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:29 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:29 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:29 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Deleted volume successfully. Jul 17 05:41:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0870b88a-f07e-4b2d-b952-33b3c47a2182 tempest-TestStampPattern-1524560404 None] Lock "cinder-9827beb7-7003-48bf-b30b-66682897ee51-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=33,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (270a5c06-f638-4ed2-8801-145c23e0bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0135ee-3052-41b0-914e-2669101140ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0135ee-3052-41b0-914e-2669101140ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824711835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ab7154-861d-4b05-8b87-c0a21a073582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:40Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a5e33e-78e7-423f-8dce-dd1ca03b2d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a5e33e-78e7-423f-8dce-dd1ca03b2d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9c4c8b-c9f6-43bd-85b2-3bcc1c3a0064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9c4c8b-c9f6-43bd-85b2-3bcc1c3a0064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ab7154-861d-4b05-8b87-c0a21a073582', 'volume_name': 'volume-c9ab7154-861d-4b05-8b87-c0a21a073582', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f953053-7724-486b-aaa3-d9ac5b02a088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f953053-7724-486b-aaa3-d9ac5b02a088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb5ea71-69f8-4392-bace-4db048df6de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Volume c9ab7154-861d-4b05-8b87-c0a21a073582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ab7154-861d-4b05-8b87-c0a21a073582', 'volume_size': 1} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824711835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ab7154-861d-4b05-8b87-c0a21a073582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:40Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Creating volume c9ab7154-861d-4b05-8b87-c0a21a073582 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:40 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 1073741824 Jul 17 05:41:40 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (8164ea83-78f9-49ef-b065-fe69b6606e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ee54ca-18c6-4eff-ad77-e7a6dee2bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ee54ca-18c6-4eff-ad77-e7a6dee2bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1848595641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7f04d5-bd94-4383-a227-5c0207ff201b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:40Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c6b13e-6349-4f96-9f69-5d835b90ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c6b13e-6349-4f96-9f69-5d835b90ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b808cfb3-9951-4363-90bc-dcbef4a7e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b808cfb3-9951-4363-90bc-dcbef4a7e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f7f04d5-bd94-4383-a227-5c0207ff201b', 'volume_name': 'volume-6f7f04d5-bd94-4383-a227-5c0207ff201b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347946f0-e9b2-4fa2-b83d-e12dc5e54667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347946f0-e9b2-4fa2-b83d-e12dc5e54667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd86ecef-d633-4ee8-9848-05615377ff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Volume 6f7f04d5-bd94-4383-a227-5c0207ff201b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f7f04d5-bd94-4383-a227-5c0207ff201b', 'volume_size': 1} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:40 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 1073741824" returned: 0 in 0.706s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:40 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 Jul 17 05:41:40 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (96384ceb-cefa-46f0-b04c-6bbb91a80365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca995c5-e056-4ccc-8448-4d7e29420157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca995c5-e056-4ccc-8448-4d7e29420157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-123783070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fb340b-3ca3-474e-8126-e7512b175bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:41Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e5ed81-6d95-4e86-a91a-e3265f29a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e5ed81-6d95-4e86-a91a-e3265f29a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124a90e9-7d27-47c8-b833-f75a624a90b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124a90e9-7d27-47c8-b833-f75a624a90b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42fb340b-3ca3-474e-8126-e7512b175bb9', 'volume_name': 'volume-42fb340b-3ca3-474e-8126-e7512b175bb9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb5373f-8c80-47c3-be7c-7cf8f52d9e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb5373f-8c80-47c3-be7c-7cf8f52d9e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660a562c-7e91-4d52-b9dc-7254271d1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Volume 42fb340b-3ca3-474e-8126-e7512b175bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42fb340b-3ca3-474e-8126-e7512b175bb9', 'volume_size': 1} Jul 17 05:41:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:41 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1848595641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7f04d5-bd94-4383-a227-5c0207ff201b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:40Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Creating volume 6f7f04d5-bd94-4383-a227-5c0207ff201b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb5ea71-69f8-4392-bace-4db048df6de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ab7154-861d-4b05-8b87-c0a21a073582', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5d897c-7134-469b-9314-e5f85ced9efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b 1073741824 Jul 17 05:41:41 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Volume volume-c9ab7154-861d-4b05-8b87-c0a21a073582 (c9ab7154-861d-4b05-8b87-c0a21a073582): created successfully Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5d897c-7134-469b-9314-e5f85ced9efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (270a5c06-f638-4ed2-8801-145c23e0bce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-23b267ac-fff7-4925-a0d4-4e2382410430 tempest-CreateVolumesFromImageTest-137390739 None] Created volume successfully. Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (78603a56-2ebb-4d90-a111-8d4a9e9d3cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304d10dd-46e0-40f5-b7ce-1a68f12187fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304d10dd-46e0-40f5-b7ce-1a68f12187fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-667833657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dc611d-963c-41ff-88b4-4bf3ba0c94ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:41Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e5959b-7dad-44fa-886c-4ad4e73d4f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e5959b-7dad-44fa-886c-4ad4e73d4f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec66d402-e8c5-4563-9836-63a5ffed14dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec66d402-e8c5-4563-9836-63a5ffed14dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37dc611d-963c-41ff-88b4-4bf3ba0c94ed', 'volume_name': 'volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a9fc14-5da9-445f-99fc-b2bd0af78a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a9fc14-5da9-445f-99fc-b2bd0af78a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aeddf9-39cb-4b7c-9a4f-3e57b666fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Volume 37dc611d-963c-41ff-88b4-4bf3ba0c94ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed', 'volume_size': 1} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (108a2b10-c3dc-4a37-8d86-6c002dcc5dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8629c8e-0001-48bd-80a1-af62b4e9924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b 1073741824" returned: 0 in 0.489s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8629c8e-0001-48bd-80a1-af62b4e9924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1579178056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a2973e-4826-49fb-9bb5-c19e34f08a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:41Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a72d8b7-a118-4d59-af52-9f42e5ae8646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a72d8b7-a118-4d59-af52-9f42e5ae8646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a00ed64-9462-45e4-97d9-b8d6197713b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a00ed64-9462-45e4-97d9-b8d6197713b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a2973e-4826-49fb-9bb5-c19e34f08a31', 'volume_name': 'volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3bd5f8-4547-48c4-8f93-2c5305c5e461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3bd5f8-4547-48c4-8f93-2c5305c5e461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6c8887-7e05-46e9-b8f1-e5940585740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Volume f6a2973e-4826-49fb-9bb5-c19e34f08a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31', 'volume_size': 1} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:41 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b Jul 17 05:41:41 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:41 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-123783070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fb340b-3ca3-474e-8126-e7512b175bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:41Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Creating volume 42fb340b-3ca3-474e-8126-e7512b175bb9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd86ecef-d633-4ee8-9848-05615377ff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7f04d5-bd94-4383-a227-5c0207ff201b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 1073741824 Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fb35c5-0150-47ea-b92d-a8f73e0caeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:41 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Volume volume-6f7f04d5-bd94-4383-a227-5c0207ff201b (6f7f04d5-bd94-4383-a227-5c0207ff201b): created successfully Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fb35c5-0150-47ea-b92d-a8f73e0caeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (8164ea83-78f9-49ef-b065-fe69b6606e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-23c67967-9f25-40c2-b1b8-f852ccfa88fa tempest-CreateVolumesFromImageTest-137390739 None] Created volume successfully. Jul 17 05:41:42 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 1073741824" returned: 0 in 0.398s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:42 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 Jul 17 05:41:42 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:42 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9" returned: 0 in 0.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-667833657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dc611d-963c-41ff-88b4-4bf3ba0c94ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:41Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Creating volume 37dc611d-963c-41ff-88b4-4bf3ba0c94ed {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:42 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:42 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed 1073741824 Jul 17 05:41:42 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660a562c-7e91-4d52-b9dc-7254271d1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fb340b-3ca3-474e-8126-e7512b175bb9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800c509b-15bb-4654-931b-5daa9497fd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Volume volume-42fb340b-3ca3-474e-8126-e7512b175bb9 (42fb340b-3ca3-474e-8126-e7512b175bb9): created successfully Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800c509b-15bb-4654-931b-5daa9497fd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (96384ceb-cefa-46f0-b04c-6bbb91a80365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-744e005b-60a2-43fc-a597-8bba6285fb90 tempest-CreateVolumesFromImageTest-137390739 None] Created volume successfully. Jul 17 05:41:43 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed 1073741824" returned: 0 in 0.473s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:43 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed Jul 17 05:41:43 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:43 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed" returned: 0 in 0.316s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1579178056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a2973e-4826-49fb-9bb5-c19e34f08a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3586df39c4c4b0aa9d09061dce08b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:41Z,use_quota=True,user_id='56eec03b06a543cb877edff70d3ae801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Creating volume f6a2973e-4826-49fb-9bb5-c19e34f08a31 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aeddf9-39cb-4b7c-9a4f-3e57b666fca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:43 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 1073741824 Jul 17 05:41:43 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c435005-ed8d-4d2b-a663-c2426dfe317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Volume volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed (37dc611d-963c-41ff-88b4-4bf3ba0c94ed): created successfully Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c435005-ed8d-4d2b-a663-c2426dfe317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (78603a56-2ebb-4d90-a111-8d4a9e9d3cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-65084ac8-53bd-40d7-8308-2f78339641ee tempest-CreateVolumesFromImageTest-137390739 None] Created volume successfully. Jul 17 05:41:44 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 1073741824" returned: 0 in 0.815s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:44 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 Jul 17 05:41:44 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:44 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6c8887-7e05-46e9-b8f1-e5940585740b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9790f0-609a-4d4e-be14-da85ac78ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Volume volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 (f6a2973e-4826-49fb-9bb5-c19e34f08a31): created successfully Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9790f0-609a-4d4e-be14-da85ac78ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Flow 'volume_create_manager' (108a2b10-c3dc-4a37-8d86-6c002dcc5dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2ea75250-d060-4e80-8faf-37d3baa0070a tempest-CreateVolumesFromImageTest-137390739 None] Created volume successfully. Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-f6a2973e-4826-49fb-9bb5-c19e34f08a31-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-f6a2973e-4826-49fb-9bb5-c19e34f08a31-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-quobyte-f6a2973e-4826-49fb-9bb5-c19e34f08a31" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-f6a2973e-4826-49fb-9bb5-c19e34f08a31" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-95d57d1e-5f92-4306-8aff-75c713d60788 tempest-TestShelveInstance-1359867918 None] Terminate volume connection completed successfully. Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-95d57d1e-5f92-4306-8aff-75c713d60788 tempest-TestShelveInstance-1359867918 None] Deleting attachment 77dcd2d1-55cc-4049-aacd-07453bd34b63. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19644e6-030f-45a4-9098-d0f33d06844f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:45 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 Jul 17 05:41:45 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Acquiring lock "cinder-12abc984-dc0f-423e-9ef1-d3213e9f1873-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Lock "cinder-12abc984-dc0f-423e-9ef1-d3213e9f1873-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Acquiring lock "cinder-quobyte-12abc984-dc0f-423e-9ef1-d3213e9f1873" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Lock "cinder-quobyte-12abc984-dc0f-423e-9ef1-d3213e9f1873" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ebd6d6-382d-430b-8b88-5f6ad036b096]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:45 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 Jul 17 05:41:45 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:45 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31" returned: 0 in 0.427s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:45 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31 Jul 17 05:41:45 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:45 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873" returned: 0 in 0.421s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:45 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873 Jul 17 05:41:45 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:45 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f6a2973e-4826-49fb-9bb5-c19e34f08a31" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-f6a2973e-4826-49fb-9bb5-c19e34f08a31" released by "delete_volume" :: held 0.776s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Created reservations ['669761f5-323d-4d57-9544-6c616b6edeb7', '9c2565ac-b2b4-44ca-ad69-312510bd61f5', '7de8a636-6780-408d-8e21-30f5d1571c61', '54939008-00e1-4b3f-8d9d-2a793dbe4742'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:46 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:46 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:46 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12abc984-dc0f-423e-9ef1-d3213e9f1873" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Lock "cinder-quobyte-12abc984-dc0f-423e-9ef1-d3213e9f1873" released by "delete_volume" :: held 0.732s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.quota [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Created reservations ['26d09151-5f10-439d-b525-8b37c8ad150f', '5ff8180c-2686-443e-b8fd-c9b0b2a39245', '263f9a45-c6d6-42be-8b74-21f72a3ae199', 'bd69332d-31f2-453c-b984-e98a69f644e6'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-37dc611d-963c-41ff-88b4-4bf3ba0c94ed-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-37dc611d-963c-41ff-88b4-4bf3ba0c94ed-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:46 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:46 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:46 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Deleted volume successfully. Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-quobyte-37dc611d-963c-41ff-88b4-4bf3ba0c94ed" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf63818c-1a67-4cd6-9fe0-2e5d601b7847 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-f6a2973e-4826-49fb-9bb5-c19e34f08a31-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-37dc611d-963c-41ff-88b4-4bf3ba0c94ed" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9da8747-0f47-4624-8cf3-07109a200782]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:46 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed Jul 17 05:41:46 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:46 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.manager [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Deleted volume successfully. Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-66c6c5bb-e20d-4ddd-89ae-667b6bbecea1 req-38efd11b-494e-4641-9814-f8f683a98224 tempest-TestShelveInstance-1359867918 None] Lock "cinder-12abc984-dc0f-423e-9ef1-d3213e9f1873-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:46 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed" returned: 0 in 0.425s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:46 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed Jul 17 05:41:46 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:47 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-37dc611d-963c-41ff-88b4-4bf3ba0c94ed" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-37dc611d-963c-41ff-88b4-4bf3ba0c94ed" released by "delete_volume" :: held 0.718s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Created reservations ['b8aad181-62b7-4062-9b64-660bcb720de8', '94431428-7ecc-46ce-9230-3311c12993e3', 'fb06b850-725f-402f-916e-522c7d2b1f96', 'c8ae6e2c-a1d5-4c64-b10d-2544c5491011'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:47 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:47 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-42fb340b-3ca3-474e-8126-e7512b175bb9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-42fb340b-3ca3-474e-8126-e7512b175bb9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-quobyte-42fb340b-3ca3-474e-8126-e7512b175bb9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-42fb340b-3ca3-474e-8126-e7512b175bb9" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:47 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Deleted volume successfully. Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39321ef-c51a-4bed-9510-427b8afe9252]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c88e0125-8f6e-42f2-a39c-81482bdae75a tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-37dc611d-963c-41ff-88b4-4bf3ba0c94ed-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:47 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 Jul 17 05:41:47 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:47 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:47 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9 Jul 17 05:41:47 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:48 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-42fb340b-3ca3-474e-8126-e7512b175bb9" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-42fb340b-3ca3-474e-8126-e7512b175bb9" released by "delete_volume" :: held 0.737s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Created reservations ['ecd8a7a2-a8ed-4ca0-ab77-e30c450463d9', 'ac84d4c4-66bd-471c-840b-69dc88d18be1', '9e671e80-5189-45b6-98c0-bd5780cfe764', '3a491ec7-f11f-41d8-a6e3-80bb1c8c4348'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:48 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:48 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-6f7f04d5-bd94-4383-a227-5c0207ff201b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:48 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-6f7f04d5-bd94-4383-a227-5c0207ff201b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Deleted volume successfully. Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4f3c491-4d53-4b52-af44-81f3bda23c76 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-42fb340b-3ca3-474e-8126-e7512b175bb9-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-quobyte-6f7f04d5-bd94-4383-a227-5c0207ff201b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-6f7f04d5-bd94-4383-a227-5c0207ff201b" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bc7c79-4269-4065-b6ea-5c678fbd0a3a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:48 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b Jul 17 05:41:48 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:49 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:49 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b Jul 17 05:41:49 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:49 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6f7f04d5-bd94-4383-a227-5c0207ff201b" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-6f7f04d5-bd94-4383-a227-5c0207ff201b" released by "delete_volume" :: held 0.687s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Created reservations ['7d42378d-1921-47e4-a2f2-cb8968647035', '0bdd367f-0bc8-4646-babb-db532b69d43f', '9eab4c6a-1f5e-4792-a811-01b3494e693f', '1acd7f84-c333-483f-bb43-fc01d4964abb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:49 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:49 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-c9ab7154-861d-4b05-8b87-c0a21a073582-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-c9ab7154-861d-4b05-8b87-c0a21a073582-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:49 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Deleted volume successfully. Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "cinder-quobyte-c9ab7154-861d-4b05-8b87-c0a21a073582" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-112b10fb-8020-42b0-9730-ba6f557d71f3 tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-6f7f04d5-bd94-4383-a227-5c0207ff201b-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-c9ab7154-861d-4b05-8b87-c0a21a073582" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b1567c-df6d-4aa3-9f78-de03d00d4241]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:41:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:50 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 Jul 17 05:41:50 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:50 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:50 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582 Jul 17 05:41:50 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:50 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9ab7154-861d-4b05-8b87-c0a21a073582" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-quobyte-c9ab7154-861d-4b05-8b87-c0a21a073582" released by "delete_volume" :: held 0.739s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Created reservations ['a6378e78-57b5-4d5d-9a44-c88cbae9d973', '08f2b5c8-8ffc-46ae-8687-46a30f778d61', '63090336-82c6-4eaf-99b1-339f7e3a1f33', 'a2e91e35-4146-496a-9924-6d4aa2a93c78'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:50 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:50 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:51 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:51 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Deleted volume successfully. Jul 17 05:41:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5cc88005-c659-47b5-b333-aec56874fdbf tempest-CreateVolumesFromImageTest-137390739 None] Lock "cinder-c9ab7154-861d-4b05-8b87-c0a21a073582-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (d0d13789-3041-4928-a779-03e145ad17b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e5544e-795e-4daf-ba24-50d929fc9fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e5544e-795e-4daf-ba24-50d929fc9fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316329733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d43a55-c435-49ad-acee-766e79f30e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:54Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905c51f9-4c13-47b9-98ba-adf139fb232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905c51f9-4c13-47b9-98ba-adf139fb232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd2ef69-52b3-4656-970d-6edf7b01679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd2ef69-52b3-4656-970d-6edf7b01679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d43a55-c435-49ad-acee-766e79f30e01', 'volume_name': 'volume-58d43a55-c435-49ad-acee-766e79f30e01', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31716f11-e708-430d-84b4-2bc13371e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31716f11-e708-430d-84b4-2bc13371e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8593fca6-3b12-40a5-8c0d-f31f26cfa02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume 58d43a55-c435-49ad-acee-766e79f30e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d43a55-c435-49ad-acee-766e79f30e01', 'volume_size': 1} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316329733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d43a55-c435-49ad-acee-766e79f30e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:54Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Creating volume 58d43a55-c435-49ad-acee-766e79f30e01 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:53 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:54 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 1073741824 Jul 17 05:41:54 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:54 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 1073741824" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:54 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 Jul 17 05:41:54 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:54 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8593fca6-3b12-40a5-8c0d-f31f26cfa02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d43a55-c435-49ad-acee-766e79f30e01', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61af1c10-38ca-4233-be1c-de0b6ae0c7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume volume-58d43a55-c435-49ad-acee-766e79f30e01 (58d43a55-c435-49ad-acee-766e79f30e01): created successfully Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61af1c10-38ca-4233-be1c-de0b6ae0c7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (d0d13789-3041-4928-a779-03e145ad17b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-93b66549-43ae-4bf2-a785-a72b3a0a6342 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created volume successfully. Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:56 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:41:56 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (c541bf71-ea13-471f-b145-da2807bd75e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361ae0c1-b181-4f47-88cb-473bf89c4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361ae0c1-b181-4f47-88cb-473bf89c4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971365379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b756b1b-9895-478d-9db0-fb0c528796a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:56Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52489173-8601-4a05-a54e-946616591c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52489173-8601-4a05-a54e-946616591c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb469bc8-2eed-47dd-b0c1-26cd41f190a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb469bc8-2eed-47dd-b0c1-26cd41f190a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b756b1b-9895-478d-9db0-fb0c528796a7', 'volume_name': 'volume-4b756b1b-9895-478d-9db0-fb0c528796a7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8f58b8-3570-4495-aaa7-736cfdb77cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8f58b8-3570-4495-aaa7-736cfdb77cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1033d9e3-633e-4a5d-9479-660a918520d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume 4b756b1b-9895-478d-9db0-fb0c528796a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b756b1b-9895-478d-9db0-fb0c528796a7', 'volume_size': 1} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971365379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b756b1b-9895-478d-9db0-fb0c528796a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:56Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Creating volume 4b756b1b-9895-478d-9db0-fb0c528796a7 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:56 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:56 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 1073741824 Jul 17 05:41:56 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:56 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (31a2cce4-4ef9-4f49-abf8-4852c1239c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57750806-fb48-49a3-b31e-fa17f7652f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57750806-fb48-49a3-b31e-fa17f7652f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162628710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f04d085-63d8-4f87-9a9a-a4e013df6917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:57Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5412dde-5f2a-43e0-8089-b82e3a0c729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5412dde-5f2a-43e0-8089-b82e3a0c729a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06973536-e987-4835-a674-43f2aaf1f329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06973536-e987-4835-a674-43f2aaf1f329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f04d085-63d8-4f87-9a9a-a4e013df6917', 'volume_name': 'volume-4f04d085-63d8-4f87-9a9a-a4e013df6917', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f417d713-53da-42db-9785-8213b648763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f417d713-53da-42db-9785-8213b648763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f64e978-7185-40ca-8706-2b25daf96f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume 4f04d085-63d8-4f87-9a9a-a4e013df6917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f04d085-63d8-4f87-9a9a-a4e013df6917', 'volume_size': 1} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:57 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 1073741824" returned: 0 in 0.580s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:57 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 Jul 17 05:41:57 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (731ae223-72fd-4bc7-a527-62724fcf27cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c261e5-33b1-42ac-a831-1a0abb7b09ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c261e5-33b1-42ac-a831-1a0abb7b09ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762007785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d52c026-7695-494e-ac56-4587d04fa233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:57Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f36f7c-e9fc-4569-ac72-d30fa4398d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f36f7c-e9fc-4569-ac72-d30fa4398d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcb2533-158f-4612-935d-f14fc68c9ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcb2533-158f-4612-935d-f14fc68c9ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d52c026-7695-494e-ac56-4587d04fa233', 'volume_name': 'volume-9d52c026-7695-494e-ac56-4587d04fa233', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6090c308-54a0-4713-93d3-f360de6e75b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6090c308-54a0-4713-93d3-f360de6e75b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6c5243-f8f1-487b-8592-484b7a98d4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume 9d52c026-7695-494e-ac56-4587d04fa233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d52c026-7695-494e-ac56-4587d04fa233', 'volume_size': 1} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:57 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7" returned: 0 in 0.313s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162628710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f04d085-63d8-4f87-9a9a-a4e013df6917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:57Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Creating volume 4f04d085-63d8-4f87-9a9a-a4e013df6917 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:57 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 1073741824 Jul 17 05:41:57 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1033d9e3-633e-4a5d-9479-660a918520d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b756b1b-9895-478d-9db0-fb0c528796a7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0176b9b7-cfe2-4760-a240-535a2cc07947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume volume-4b756b1b-9895-478d-9db0-fb0c528796a7 (4b756b1b-9895-478d-9db0-fb0c528796a7): created successfully Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0176b9b7-cfe2-4760-a240-535a2cc07947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (c541bf71-ea13-471f-b145-da2807bd75e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9ca7ca85-ea17-44cf-81ac-8ca35b731df3 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created volume successfully. Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (a6c54d94-718b-4bc7-af8b-8ec739dc8b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f127fbc4-4c4c-40c6-9b0e-7626af57a31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f127fbc4-4c4c-40c6-9b0e-7626af57a31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1528324357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e051f9f-0ee8-42af-9181-0f11ee586f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:58Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5626e5f9-5392-446b-b143-b009c6fd8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5626e5f9-5392-446b-b143-b009c6fd8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78057928-cd27-4beb-a7d8-ee86d162d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78057928-cd27-4beb-a7d8-ee86d162d49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e051f9f-0ee8-42af-9181-0f11ee586f43', 'volume_name': 'volume-8e051f9f-0ee8-42af-9181-0f11ee586f43', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfb4bc3-f415-4bd0-a63d-6f98ca29b2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfb4bc3-f415-4bd0-a63d-6f98ca29b2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd03260d-8a6a-42a6-885d-55dbfacf7748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume 8e051f9f-0ee8-42af-9181-0f11ee586f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e051f9f-0ee8-42af-9181-0f11ee586f43', 'volume_size': 1} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:58 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 1073741824" returned: 0 in 0.586s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:58 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 Jul 17 05:41:58 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (b530d857-0cf4-418c-a376-2950f09139c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19033b15-0d31-46cd-9125-0bbfed1f99ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19033b15-0d31-46cd-9125-0bbfed1f99ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1711937636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062ce1fc-1aa1-4ae4-a85c-348fd9bcd648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:58Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1822f7f-b97f-499c-8ef9-51ce75f92cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1822f7f-b97f-499c-8ef9-51ce75f92cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9afa4e-8718-4c9f-9583-7308e573a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9afa4e-8718-4c9f-9583-7308e573a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062ce1fc-1aa1-4ae4-a85c-348fd9bcd648', 'volume_name': 'volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e9f26b-dba3-45de-b622-29defca84c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e9f26b-dba3-45de-b622-29defca84c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59899e08-6593-4b37-9bf9-c0990cc2b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume 062ce1fc-1aa1-4ae4-a85c-348fd9bcd648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648', 'volume_size': 1} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:58 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762007785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d52c026-7695-494e-ac56-4587d04fa233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:57Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Creating volume 9d52c026-7695-494e-ac56-4587d04fa233 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:58 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f64e978-7185-40ca-8706-2b25daf96f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f04d085-63d8-4f87-9a9a-a4e013df6917', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 1073741824 Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72d2111-6661-4af9-be42-92f975f89d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:58 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 (4f04d085-63d8-4f87-9a9a-a4e013df6917): created successfully Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72d2111-6661-4af9-be42-92f975f89d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (31a2cce4-4ef9-4f49-abf8-4852c1239c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-08e479ce-7dff-4a6a-85dc-407a0599cfa8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created volume successfully. Jul 17 05:41:58 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 1073741824" returned: 0 in 0.432s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:58 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 Jul 17 05:41:58 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:59 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1528324357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e051f9f-0ee8-42af-9181-0f11ee586f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:58Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Creating volume 8e051f9f-0ee8-42af-9181-0f11ee586f43 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:59 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6c5243-f8f1-487b-8592-484b7a98d4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d52c026-7695-494e-ac56-4587d04fa233', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90a6ada-5e21-4438-b86a-fb7ea6b1e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:59 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 1073741824 Jul 17 05:41:59 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume volume-9d52c026-7695-494e-ac56-4587d04fa233 (9d52c026-7695-494e-ac56-4587d04fa233): created successfully Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90a6ada-5e21-4438-b86a-fb7ea6b1e067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (731ae223-72fd-4bc7-a527-62724fcf27cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:41:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8228019a-3d82-4247-9774-1afd51caf694 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created volume successfully. Jul 17 05:41:59 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 1073741824" returned: 0 in 0.466s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:59 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 Jul 17 05:41:59 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:59 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1711937636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062ce1fc-1aa1-4ae4-a85c-348fd9bcd648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf9958b2fcc4a6e89508e53e7f60f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:41:58Z,use_quota=True,user_id='58df6ff5c63345dcbbd640aca0d077bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Creating volume 062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:41:59 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd03260d-8a6a-42a6-885d-55dbfacf7748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e051f9f-0ee8-42af-9181-0f11ee586f43', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:41:59 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 1073741824 Jul 17 05:41:59 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:41:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd97b977-67a2-438b-a838-2f9d3f9caa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:41:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 (8e051f9f-0ee8-42af-9181-0f11ee586f43): created successfully Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd97b977-67a2-438b-a838-2f9d3f9caa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (a6c54d94-718b-4bc7-af8b-8ec739dc8b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4750937e-7db1-4f77-a4ad-a5233e721122 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created volume successfully. Jul 17 05:42:00 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 1073741824" returned: 0 in 0.481s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:00 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 Jul 17 05:42:00 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:00 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59899e08-6593-4b37-9bf9-c0990cc2b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af88310-a564-493e-a9ad-16512195c8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Volume volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 (062ce1fc-1aa1-4ae4-a85c-348fd9bcd648): created successfully Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af88310-a564-493e-a9ad-16512195c8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Flow 'volume_create_manager' (b530d857-0cf4-418c-a376-2950f09139c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e7647b97-cf66-4577-a1c6-c90058efa80d tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created volume successfully. Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Flow 'volume_create_manager' (7003016e-8089-40b5-b08f-a74e99ebfe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e49743-2809-40f8-acce-909f9aa7585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e49743-2809-40f8-acce-909f9aa7585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c436e18-6dfc-4b0d-b356-4252f19b51f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a217947b22c47d399d68aafd4d2a699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:02Z,use_quota=True,user_id='900ff4e19519453b94fea6ddb1376a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffa12179-64a8-48ee-aabd-1e718963792f),volume_type_id=ffa12179-64a8-48ee-aabd-1e718963792f)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e102e8-d1bb-4397-a6a9-89a0e3a7a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e102e8-d1bb-4397-a6a9-89a0e3a7a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed1c1f1-0f66-4053-8ad3-729f727e6ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-quobyte-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7e4374-2b2e-4191-bee4-6bb72cf9ce9b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:01 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 Jul 17 05:42:01 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed1c1f1-0f66-4053-8ad3-729f727e6ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c436e18-6dfc-4b0d-b356-4252f19b51f4', 'volume_name': 'volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4', 'volume_size': 1, 'image_id': '38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2c7fd392c48b62ec43c5c42ce111ca0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a217947b22c47d399d68aafd4d2a699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '209bd1bdee07018acda85038458fe7debf4e08424aaecb0d27ea221a3b2fdf889f714366e85235543955c1db21dc6e7be0e08b1863537c864bf270f53778dbc0', 'id': '38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'created_at': datetime.datetime(2026, 7, 17, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 42, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb2b172-d9ad-4157-b11a-69ca6412a04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb2b172-d9ad-4157-b11a-69ca6412a04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a161b3dc-b9b2-41f9-bd33-babb2000775c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Volume 8c436e18-6dfc-4b0d-b356-4252f19b51f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4', 'volume_size': 1, 'image_id': '38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2c7fd392c48b62ec43c5c42ce111ca0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a217947b22c47d399d68aafd4d2a699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '209bd1bdee07018acda85038458fe7debf4e08424aaecb0d27ea221a3b2fdf889f714366e85235543955c1db21dc6e7be0e08b1863537c864bf270f53778dbc0', 'id': '38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'created_at': datetime.datetime(2026, 7, 17, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 42, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Trying to clone 8c436e18-6dfc-4b0d-b356-4252f19b51f4 from image 38d23381-c821-46f2-83e2-f6ec46d3e5f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:42:02 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Image download 0.00 MB at 0.00 MB/s Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff3d8d-bf39-4a18-8a09-475e6fcdfbd6]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:02 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:02 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648 Jul 17 05:42:02 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:02 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD Jul 17 05:42:02 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:02 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:02 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648" released by "delete_volume" :: held 0.684s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created reservations ['10aae966-6d39-44ee-a713-27d0d1d79865', 'bea4f8c6-b97f-496b-b543-7159be375000', 'efa28a50-90ac-4c94-97e9-e95f98a10695', '52b6b461-3342-41a8-beb4-31f00837be66'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:02 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD Jul 17 05:42:02 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:02 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:02 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:02 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Temporary image 38d23381-c821-46f2-83e2-f6ec46d3e5f2 is fetched for user 900ff4e19519453b94fea6ddb1376a3f. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b426b1bf-d36a-4f63-b0ef-5bb74006b108]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:02 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Deleted volume successfully. Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3787dafa-7009-4193-bd55-fabdbe529400 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-062ce1fc-1aa1-4ae4-a85c-348fd9bcd648-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-8e051f9f-0ee8-42af-9181-0f11ee586f43-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:03 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD Jul 17 05:42:03 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-8e051f9f-0ee8-42af-9181-0f11ee586f43-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-quobyte-8e051f9f-0ee8-42af-9181-0f11ee586f43" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-8e051f9f-0ee8-42af-9181-0f11ee586f43" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea647fc-7edb-4ad0-8da3-a67a09dd31d5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:03 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 Jul 17 05:42:03 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:03 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:03 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD Jul 17 05:42:03 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:03 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:03 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43 Jul 17 05:42:03 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:03 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c436e18-6dfc-4b0d-b356-4252f19b51f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a217947b22c47d399d68aafd4d2a699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:02Z,use_quota=True,user_id='900ff4e19519453b94fea6ddb1376a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffa12179-64a8-48ee-aabd-1e718963792f),volume_type_id=ffa12179-64a8-48ee-aabd-1e718963792f)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Creating volume 8c436e18-6dfc-4b0d-b356-4252f19b51f4 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:42:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:03 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 1073741824 Jul 17 05:42:03 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:03 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8e051f9f-0ee8-42af-9181-0f11ee586f43" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-8e051f9f-0ee8-42af-9181-0f11ee586f43" released by "delete_volume" :: held 0.671s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created reservations ['56899ff1-a2ae-433c-a1bf-62b4be8e3249', '52aa5ec6-2688-4582-a338-e49e1a78be69', '4def3fbb-990a-4bcf-bde3-5d374b779f7c', '27f898dc-46d9-4267-819a-5ae6bbcde2db'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:03 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:03 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:04 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 1073741824" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:04 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 Jul 17 05:42:04 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:04 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-9d52c026-7695-494e-ac56-4587d04fa233-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Deleted volume successfully. Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-9d52c026-7695-494e-ac56-4587d04fa233-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e227beb9-d25d-4bb1-9d1b-0d6b55fc9856 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-8e051f9f-0ee8-42af-9181-0f11ee586f43-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-quobyte-9d52c026-7695-494e-ac56-4587d04fa233" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-9d52c026-7695-494e-ac56-4587d04fa233" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c9a97-2419-4875-872f-3c8f2b96cc21]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:04 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 Jul 17 05:42:04 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:04 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Attempting download of 38d23381-c821-46f2-83e2-f6ec46d3e5f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'metadata': {}}])) to volume 8c436e18-6dfc-4b0d-b356-4252f19b51f4. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[165d8cfe-f0bc-44cb-94df-59bf4875e29d]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38d23381-c821-46f2-83e2-f6ec46d3e5f2_y1pw9lfb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:04 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38d23381-c821-46f2-83e2-f6ec46d3e5f2_y1pw9lfb Jul 17 05:42:04 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:04 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:04 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233 Jul 17 05:42:04 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:04 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38d23381-c821-46f2-83e2-f6ec46d3e5f2_y1pw9lfb" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38d23381-c821-46f2-83e2-f6ec46d3e5f2_y1pw9lfb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:04 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-9d52c026-7695-494e-ac56-4587d04fa233" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:04 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38d23381-c821-46f2-83e2-f6ec46d3e5f2_y1pw9lfb Jul 17 05:42:04 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-9d52c026-7695-494e-ac56-4587d04fa233" released by "delete_volume" :: held 0.658s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created reservations ['5cb4a5e3-6672-4d3c-a00c-3cf88b2c846d', 'eea403ae-a66f-46bf-8985-e68fa5e1a489', 'ec31280b-475a-4d68-80a7-102c33aa9ce5', '5950cace-c704-4d46-9111-3c4433926ffd'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:05 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:05 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:05 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38d23381-c821-46f2-83e2-f6ec46d3e5f2_y1pw9lfb" returned: 1 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38d23381-c821-46f2-83e2-f6ec46d3e5f2_y1pw9lfb' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b981d3b6-bfd7-4cb5-bd0d-caa62081811f]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:05 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD Jul 17 05:42:05 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:05 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Deleted volume successfully. Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8ca4ea0a-8683-480d-a72d-48a79a950d84 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-9d52c026-7695-494e-ac56-4587d04fa233-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-4f04d085-63d8-4f87-9a9a-a4e013df6917-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-4f04d085-63d8-4f87-9a9a-a4e013df6917-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-quobyte-4f04d085-63d8-4f87-9a9a-a4e013df6917" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-4f04d085-63d8-4f87-9a9a-a4e013df6917" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:05 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e12fe-2d68-4ed2-b448-0370bf4e8e38]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:05 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 Jul 17 05:42:05 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:05 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD Jul 17 05:42:05 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:05 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] 38d23381-c821-46f2-83e2-f6ec46d3e5f2 was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:05 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917" returned: 0 in 0.365s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:05 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 Jul 17 05:42:05 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:05 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917 Jul 17 05:42:05 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:06 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4f04d085-63d8-4f87-9a9a-a4e013df6917" returned: 0 in 0.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-4f04d085-63d8-4f87-9a9a-a4e013df6917" released by "delete_volume" :: held 0.657s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created reservations ['c79693fd-5f69-41b3-87b7-d2eb495ac5ec', 'b7f57d70-96e1-47ba-9aba-fbe869e1f31b', '4ffda21e-f5fd-4fee-a30d-802564412660', '32efcbbb-77f5-43e7-ad4a-334d967aae01'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:06 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:06 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:06 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4" returned: 0 in 0.511s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_38d23381-c821-46f2-83e2-f6ec46d3e5f2_lsk_56redevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:42:06 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:06 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 1G Jul 17 05:42:06 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:06 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Deleted volume successfully. Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b1cb5fb7-26cd-4e3a-9eb5-34a6f9552c0a tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-4f04d085-63d8-4f87-9a9a-a4e013df6917-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-4b756b1b-9895-478d-9db0-fb0c528796a7-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-4b756b1b-9895-478d-9db0-fb0c528796a7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-quobyte-4b756b1b-9895-478d-9db0-fb0c528796a7" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-4b756b1b-9895-478d-9db0-fb0c528796a7" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c449eef-1029-4cd4-82f3-9c61fbf9fb99]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:06 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 1G" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Downloaded image 38d23381-c821-46f2-83e2-f6ec46d3e5f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'metadata': {}}])) to volume 8c436e18-6dfc-4b0d-b356-4252f19b51f4 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Temporary image 38d23381-c821-46f2-83e2-f6ec46d3e5f2 for user 900ff4e19519453b94fea6ddb1376a3f is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Marking volume 8c436e18-6dfc-4b0d-b356-4252f19b51f4 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Copying metadata from image 38d23381-c821-46f2-83e2-f6ec46d3e5f2 to 8c436e18-6dfc-4b0d-b356-4252f19b51f4. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Creating volume glance metadata for volume 8c436e18-6dfc-4b0d-b356-4252f19b51f4 backed by image 38d23381-c821-46f2-83e2-f6ec46d3e5f2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e2c7fd392c48b62ec43c5c42ce111ca0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:42:06 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 Jul 17 05:42:06 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a161b3dc-b9b2-41f9-bd33-babb2000775c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4', 'volume_size': 1, 'image_id': '38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2c7fd392c48b62ec43c5c42ce111ca0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a217947b22c47d399d68aafd4d2a699', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '209bd1bdee07018acda85038458fe7debf4e08424aaecb0d27ea221a3b2fdf889f714366e85235543955c1db21dc6e7be0e08b1863537c864bf270f53778dbc0', 'id': '38d23381-c821-46f2-83e2-f6ec46d3e5f2', 'created_at': datetime.datetime(2026, 7, 17, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 42, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38d23381-c821-46f2-83e2-f6ec46d3e5f2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162d5108-11b0-4a74-8ec3-f310c3fb7065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:06 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Volume volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 (8c436e18-6dfc-4b0d-b356-4252f19b51f4): created successfully Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162d5108-11b0-4a74-8ec3-f310c3fb7065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Flow 'volume_create_manager' (7003016e-8089-40b5-b08f-a74e99ebfe2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5d144505-e79a-4381-bdb1-445c39708931 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Created volume successfully. Jul 17 05:42:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Acquiring lock "cinder-8c436e18-6dfc-4b0d-b356-4252f19b51f4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "cinder-8c436e18-6dfc-4b0d-b356-4252f19b51f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Acquiring lock "cinder-quobyte-8c436e18-6dfc-4b0d-b356-4252f19b51f4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "cinder-quobyte-8c436e18-6dfc-4b0d-b356-4252f19b51f4" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:07 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1019ed4-9383-420c-90b8-c577ff7f64d0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:07 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7 Jul 17 05:42:07 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:07 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 Jul 17 05:42:07 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:07 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4b756b1b-9895-478d-9db0-fb0c528796a7" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-4b756b1b-9895-478d-9db0-fb0c528796a7" released by "delete_volume" :: held 0.690s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created reservations ['db422766-5473-4cd8-b5f3-97c577d08335', '4e021518-4951-4527-bea7-f70a1930eb17', 'c3623cea-f842-4697-aab5-90e09805b721', 'cd4cc59b-e5f9-4a07-a31c-6297aeeb647a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:07 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:07 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:07 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:07 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4 Jul 17 05:42:07 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:07 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Deleted volume successfully. Jul 17 05:42:07 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8c436e18-6dfc-4b0d-b356-4252f19b51f4" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-58d43a55-c435-49ad-acee-766e79f30e01-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "cinder-quobyte-8c436e18-6dfc-4b0d-b356-4252f19b51f4" released by "delete_volume" :: held 0.721s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5f0f6b3-a984-49ff-bdaf-f15e0adbd337 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-4b756b1b-9895-478d-9db0-fb0c528796a7-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-58d43a55-c435-49ad-acee-766e79f30e01-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:07 devstack cinder-volume[87750]: WARNING cinder.quota [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:42:07 devstack cinder-volume[87750]: WARNING cinder.quota [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "cinder-quobyte-58d43a55-c435-49ad-acee-766e79f30e01" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Created reservations ['3b6efa9d-ad0a-42d0-b07f-5c01345fb834', '8ff35d56-c325-4066-8ad4-651d5f409711', '08ac479e-093c-49be-b84d-c35aed777cec', '6b0e5acf-5a30-4dbe-a960-5d4d478d0e6d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-58d43a55-c435-49ad-acee-766e79f30e01" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5aeb45-0bac-45a8-8009-2067682185bb]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:07 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:07 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:08 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 Jul 17 05:42:08 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:08 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.283s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Deleted volume successfully. Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cc6bb73f-f015-4c49-9456-3c915835fcc5 tempest-VolumeAndVolumeTypeFromImageTest-1724718668 None] Lock "cinder-8c436e18-6dfc-4b0d-b356-4252f19b51f4-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:08 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01" returned: 0 in 0.408s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:08 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01 Jul 17 05:42:08 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:08 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-58d43a55-c435-49ad-acee-766e79f30e01" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-quobyte-58d43a55-c435-49ad-acee-766e79f30e01" released by "delete_volume" :: held 0.708s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Created reservations ['4a683313-77c9-43bc-b317-11660beb689a', '951fa253-1940-4ae5-a04b-129906fb5fbe', '17cf9d9c-bd5b-4dc9-9dad-374b04bec9f6', 'b9e4557f-3ecf-403e-9395-5040518d6de9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:08 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:08 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:08 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Deleted volume successfully. Jul 17 05:42:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-569cc3ef-f992-416f-acf3-310dd345f2b8 tempest-CreateVolumesFromSourceVolumeTest-1567274631 None] Lock "cinder-58d43a55-c435-49ad-acee-766e79f30e01-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Flow 'volume_create_manager' (02ffe0a3-ccb3-42e8-a62e-a77bad5e6ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8419ac1b-2be9-4707-82e9-8aa07ac4736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8419ac1b-2be9-4707-82e9-8aa07ac4736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1043837727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba461500-b509-4e70-b710-7e9af4f34293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6c4b7096434c6090ca1bb1a0d97d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:13Z,use_quota=True,user_id='45ca56da4dc14522b2d3bb819f9ee474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de240989-2859-4845-a220-1c725f530762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de240989-2859-4845-a220-1c725f530762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55fe04b-ac3a-4dca-91ec-35a01208268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55fe04b-ac3a-4dca-91ec-35a01208268e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba461500-b509-4e70-b710-7e9af4f34293', 'volume_name': 'volume-ba461500-b509-4e70-b710-7e9af4f34293', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853800da-cedd-4d9f-9fd1-a1a058874f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853800da-cedd-4d9f-9fd1-a1a058874f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500950c1-bb99-448d-910a-2eba0ad0c865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Volume ba461500-b509-4e70-b710-7e9af4f34293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba461500-b509-4e70-b710-7e9af4f34293', 'volume_size': 1} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1043837727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba461500-b509-4e70-b710-7e9af4f34293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6c4b7096434c6090ca1bb1a0d97d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:13Z,use_quota=True,user_id='45ca56da4dc14522b2d3bb819f9ee474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Creating volume ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:42:12 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:42:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:12 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 1073741824 Jul 17 05:42:12 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:13 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 1073741824" returned: 0 in 0.445s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:13 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 Jul 17 05:42:13 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:13 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293" returned: 0 in 0.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500950c1-bb99-448d-910a-2eba0ad0c865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba461500-b509-4e70-b710-7e9af4f34293', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53227824-865a-4144-9a6e-137c1cffb010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Volume volume-ba461500-b509-4e70-b710-7e9af4f34293 (ba461500-b509-4e70-b710-7e9af4f34293): created successfully Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53227824-865a-4144-9a6e-137c1cffb010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Flow 'volume_create_manager' (02ffe0a3-ccb3-42e8-a62e-a77bad5e6ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2c5fc4e4-4e4a-4d77-89c0-9df7a1e12171 tempest-VolumeDependencyTests-441963029 None] Created volume successfully. Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Creating offline snapshot fb93a952-bf61-4b1e-805c-ab79e517ef65 of volume ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:42:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96e3aa-4d30-4a29-99ca-524b53588ac3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:14 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 Jul 17 05:42:14 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:14 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293" returned: 0 in 0.380s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:14 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 1G Jul 17 05:42:14 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:14 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 1G" returned: 0 in 0.424s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba461500-b509-4e70-b710-7e9af4f34293 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:14 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba461500-b509-4e70-b710-7e9af4f34293 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 Jul 17 05:42:14 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:15 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba461500-b509-4e70-b710-7e9af4f34293 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:15 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 is being set with open permissions: ugo+rw Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:15 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 Jul 17 05:42:15 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:15 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:15 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.info Jul 17 05:42:15 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:15 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.info" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:15 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.info is being set with open permissions: ugo+rw Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:15 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.info Jul 17 05:42:15 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:15 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.info" returned: 0 in 0.228s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-48fb0130-d8a2-40fc-9a42-911a0a74513b tempest-VolumeDependencyTests-441963029 None] Create snapshot completed successfully Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Flow 'volume_create_manager' (24ab8abf-0744-49f0-b74a-848f1d3ab6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e04a4cb-8bd6-4a93-a865-fcc70ad1a0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e04a4cb-8bd6-4a93-a865-fcc70ad1a0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1629090473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41988eb7-600a-4c04-9582-8df096aa5f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6c4b7096434c6090ca1bb1a0d97d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb93a952-bf61-4b1e-805c-ab79e517ef65,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:17Z,use_quota=True,user_id='45ca56da4dc14522b2d3bb819f9ee474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18abc389-0990-4842-9c19-2ebeb5cdd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18abc389-0990-4842-9c19-2ebeb5cdd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2869a8c-99d5-4d27-85ab-8fb85f0f1d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2869a8c-99d5-4d27-85ab-8fb85f0f1d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41988eb7-600a-4c04-9582-8df096aa5f6d', 'volume_name': 'volume-41988eb7-600a-4c04-9582-8df096aa5f6d', 'volume_size': 1, 'snapshot_id': 'fb93a952-bf61-4b1e-805c-ab79e517ef65'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c4a910-4895-416e-ac1b-b121480bd6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c4a910-4895-416e-ac1b-b121480bd6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0e0c55-9723-4c9e-a860-fc6fd2e5755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Volume 41988eb7-600a-4c04-9582-8df096aa5f6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41988eb7-600a-4c04-9582-8df096aa5f6d', 'volume_size': 1, 'snapshot_id': 'fb93a952-bf61-4b1e-805c-ab79e517ef65'} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-quobyte-fb93a952-bf61-4b1e-805c-ab79e517ef65-41988eb7-600a-4c04-9582-8df096aa5f6d" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-fb93a952-bf61-4b1e-805c-ab79e517ef65-41988eb7-600a-4c04-9582-8df096aa5f6d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Creating volume 41988eb7-600a-4c04-9582-8df096aa5f6d from snapshot fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-quobyte-41988eb7-600a-4c04-9582-8df096aa5f6d" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-41988eb7-600a-4c04-9582-8df096aa5f6d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] snapshot: fb93a952-bf61-4b1e-805c-ab79e517ef65, volume: 41988eb7-600a-4c04-9582-8df096aa5f6d, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ffaf12-e1f6-414c-b497-d876d2521ece]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:16 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 Jul 17 05:42:16 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:17 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65" returned: 0 in 0.351s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba461500-b509-4e70-b710-7e9af4f34293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[20737ba6-37fd-4ef1-bcd2-0a75bae3aaf0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:17 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 Jul 17 05:42:17 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:17 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:42:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:17 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d Jul 17 05:42:17 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:21 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d" returned: 0 in 3.670s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d04b80-da10-4364-80e5-e69804a80ce0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:21 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 Jul 17 05:42:21 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:21 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293" returned: 0 in 0.508s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293, size 1024.00 MB, duration 3.67 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:42:21 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Converted 1024.00 MB image at 278.92 MB/s Jul 17 05:42:21 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d is being set with open permissions: ugo+rw Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:21 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d Jul 17 05:42:21 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:21 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-41988eb7-600a-4c04-9582-8df096aa5f6d" released by "_copy_volume_from_snapshot" :: held 5.197s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-fb93a952-bf61-4b1e-805c-ab79e517ef65-41988eb7-600a-4c04-9582-8df096aa5f6d" released by "_create_volume_from_snapshot" :: held 5.230s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.245s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0e0c55-9723-4c9e-a860-fc6fd2e5755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41988eb7-600a-4c04-9582-8df096aa5f6d', 'volume_size': 1, 'snapshot_id': 'fb93a952-bf61-4b1e-805c-ab79e517ef65'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d446cbf-2d93-4004-8145-bba0df981547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Volume volume-41988eb7-600a-4c04-9582-8df096aa5f6d (41988eb7-600a-4c04-9582-8df096aa5f6d): created successfully Jul 17 05:42:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d446cbf-2d93-4004-8145-bba0df981547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Flow 'volume_create_manager' (24ab8abf-0744-49f0-b74a-848f1d3ab6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7348e0f3-d744-4f31-bd63-8ac880890b4a tempest-VolumeDependencyTests-441963029 None] Created volume successfully. Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-fb93a952-bf61-4b1e-805c-ab79e517ef65-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-fb93a952-bf61-4b1e-805c-ab79e517ef65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-quobyte-ba461500-b509-4e70-b710-7e9af4f34293" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-ba461500-b509-4e70-b710-7e9af4f34293" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-quobyte-fb93a952-bf61-4b1e-805c-ab79e517ef65" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-fb93a952-bf61-4b1e-805c-ab79e517ef65" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Deleting offline snapshot fb93a952-bf61-4b1e-805c-ab79e517ef65 of volume ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] snapshot_file for this snap is: volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[46559b4a-8ae1-406d-96c0-f352b6eb5514]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:23 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 Jul 17 05:42:23 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:23 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba461500-b509-4e70-b710-7e9af4f34293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8db38-d9fd-4ac7-a6b1-3fa047a8bf5b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:23 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 Jul 17 05:42:23 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:23 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293" returned: 0 in 0.338s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:23 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 Jul 17 05:42:23 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:24 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:24 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65 Jul 17 05:42:24 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:24 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293.fb93a952-bf61-4b1e-805c-ab79e517ef65" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-fb93a952-bf61-4b1e-805c-ab79e517ef65" released by "_delete_snapshot" :: held 1.327s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-ba461500-b509-4e70-b710-7e9af4f34293" released by "delete_snapshot" :: held 1.347s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Created reservations ['288d30a5-99d4-4bd9-95d3-c2d287cf5cef', '1daa067d-6f2b-417f-a5e0-8f1caeb504a6', 'd986bb8b-c4fd-4f1c-abad-e9a750c7058c', '28e76fb7-b77a-4e99-b6ed-ed89b4fe29b8'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Delete snapshot completed successfully. Jul 17 05:42:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38762298-1561-4345-883f-e31ed2828e42 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-fb93a952-bf61-4b1e-805c-ab79e517ef65-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-ba461500-b509-4e70-b710-7e9af4f34293-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-ba461500-b509-4e70-b710-7e9af4f34293-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-quobyte-ba461500-b509-4e70-b710-7e9af4f34293" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-ba461500-b509-4e70-b710-7e9af4f34293" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[853620ca-67dc-4b81-963e-bb50d3979916]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:25 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 Jul 17 05:42:25 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:25 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:25 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293 Jul 17 05:42:25 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:25 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ba461500-b509-4e70-b710-7e9af4f34293" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-ba461500-b509-4e70-b710-7e9af4f34293" released by "delete_volume" :: held 0.631s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:25 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Created reservations ['f7ed69c0-666b-462b-8304-20938d969060', 'f6f8ab04-3e93-4f3e-aada-1850a40a0ad3', '0d5dbd18-5a75-484b-a2b1-9ecc90299a12', 'bfd0e1cd-2960-4917-a580-7b5c85f5663a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:26 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:26 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:26 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Deleted volume successfully. Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d5da91c0-34d7-4245-ae42-63bd9f26b932 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-ba461500-b509-4e70-b710-7e9af4f34293-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-41988eb7-600a-4c04-9582-8df096aa5f6d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-41988eb7-600a-4c04-9582-8df096aa5f6d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "cinder-quobyte-41988eb7-600a-4c04-9582-8df096aa5f6d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-41988eb7-600a-4c04-9582-8df096aa5f6d" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f6f24-b91d-472e-b046-1bd214675a4c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:26 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d Jul 17 05:42:26 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:26 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d" returned: 0 in 0.358s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:26 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d Jul 17 05:42:26 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:27 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-41988eb7-600a-4c04-9582-8df096aa5f6d" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-quobyte-41988eb7-600a-4c04-9582-8df096aa5f6d" released by "delete_volume" :: held 0.665s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Created reservations ['11f92487-d935-404d-b888-3a6ba81a2204', 'd960ee1b-0935-4637-b6eb-468e9ebe2538', 'fa823d2d-4848-44c5-9551-a021f7423d4d', 'f2501ab4-ce3c-4fab-8360-629c7d21fec1'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:27 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:27 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:27 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.240s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Deleted volume successfully. Jul 17 05:42:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e491887f-c054-4bd7-894c-35ae9639eb56 tempest-VolumeDependencyTests-441963029 None] Lock "cinder-41988eb7-600a-4c04-9582-8df096aa5f6d-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Flow 'volume_create_manager' (c9d92e4b-3fc3-47f9-9d54-d79a2abfdcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc962a3-a686-4848-9aaa-9793e805429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc962a3-a686-4848-9aaa-9793e805429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986111506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed9d130-eba0-4a7a-becf-85aa7f67a506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39a3e58a5bd4bd2810426a233ccfa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:31Z,use_quota=True,user_id='80eaf893329c4d33a6e1ea0b371aad77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a32705-3a70-4f32-b7e7-0f1a2191d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a32705-3a70-4f32-b7e7-0f1a2191d89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ba8c55-ebe1-4279-b239-621461b9cae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ba8c55-ebe1-4279-b239-621461b9cae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed9d130-eba0-4a7a-becf-85aa7f67a506', 'volume_name': 'volume-eed9d130-eba0-4a7a-becf-85aa7f67a506', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfd13f9-d023-4b9a-a984-dd982db93a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfd13f9-d023-4b9a-a984-dd982db93a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05a4636-e928-4f16-8066-715a63f101c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Volume eed9d130-eba0-4a7a-becf-85aa7f67a506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed9d130-eba0-4a7a-becf-85aa7f67a506', 'volume_size': 1} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986111506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed9d130-eba0-4a7a-becf-85aa7f67a506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39a3e58a5bd4bd2810426a233ccfa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:31Z,use_quota=True,user_id='80eaf893329c4d33a6e1ea0b371aad77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Creating volume eed9d130-eba0-4a7a-becf-85aa7f67a506 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:42:30 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:42:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:30 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 1073741824 Jul 17 05:42:30 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:31 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 1073741824" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:31 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 Jul 17 05:42:31 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:31 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05a4636-e928-4f16-8066-715a63f101c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed9d130-eba0-4a7a-becf-85aa7f67a506', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86155f2d-7b26-4a8f-956c-a37f28b91046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Volume volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 (eed9d130-eba0-4a7a-becf-85aa7f67a506): created successfully Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86155f2d-7b26-4a8f-956c-a37f28b91046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Flow 'volume_create_manager' (c9d92e4b-3fc3-47f9-9d54-d79a2abfdcc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b3da5aed-2d74-4cdc-bfe4-79fbdcf7dcb1 tempest-ProjectReaderTests-242124027 None] Created volume successfully. Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Acquiring lock "cinder-eed9d130-eba0-4a7a-becf-85aa7f67a506-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Lock "cinder-eed9d130-eba0-4a7a-becf-85aa7f67a506-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Acquiring lock "cinder-quobyte-eed9d130-eba0-4a7a-becf-85aa7f67a506" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Lock "cinder-quobyte-eed9d130-eba0-4a7a-becf-85aa7f67a506" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad3734d-86a1-4e7a-93f8-931fd0376741]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:32 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 Jul 17 05:42:32 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:32 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:32 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506 Jul 17 05:42:32 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:32 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-eed9d130-eba0-4a7a-becf-85aa7f67a506" returned: 0 in 0.228s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Lock "cinder-quobyte-eed9d130-eba0-4a7a-becf-85aa7f67a506" released by "delete_volume" :: held 0.614s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Created reservations ['ee41ddea-ca4f-4e3c-8bf5-3a9e5cfa3786', '67710cdb-c62e-45ac-9124-936d1549d35a', 'cc7f19ab-6912-4e0e-8dd5-a60aedc875fd', 'c2386f06-d561-4729-9238-db7a60816771'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:32 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:32 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:33 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.229s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Deleted volume successfully. Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-825e1328-a1fb-47aa-a4f7-9da0d9fff935 tempest-ProjectReaderTests-242124027 None] Lock "cinder-eed9d130-eba0-4a7a-becf-85aa7f67a506-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Flow 'volume_create_manager' (c47dc647-9135-4288-95a2-b7d320e35318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a631b4c1-367c-4a91-9c49-1644610d182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a631b4c1-367c-4a91-9c49-1644610d182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695889833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8194351-8f28-4b81-9df7-58e00e8d011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39a3e58a5bd4bd2810426a233ccfa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:34Z,use_quota=True,user_id='80eaf893329c4d33a6e1ea0b371aad77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a2d993-0dcb-4092-8a8e-2c7969234e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a2d993-0dcb-4092-8a8e-2c7969234e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27840f01-b812-473e-844b-d82128040959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27840f01-b812-473e-844b-d82128040959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8194351-8f28-4b81-9df7-58e00e8d011c', 'volume_name': 'volume-b8194351-8f28-4b81-9df7-58e00e8d011c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21624ff-5d81-42a1-8bb7-e443997ecbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21624ff-5d81-42a1-8bb7-e443997ecbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2f93bd-7922-4f4a-8c71-85d7d5686e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Volume b8194351-8f28-4b81-9df7-58e00e8d011c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8194351-8f28-4b81-9df7-58e00e8d011c', 'volume_size': 1} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695889833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8194351-8f28-4b81-9df7-58e00e8d011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39a3e58a5bd4bd2810426a233ccfa4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:42:34Z,use_quota=True,user_id='80eaf893329c4d33a6e1ea0b371aad77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Creating volume b8194351-8f28-4b81-9df7-58e00e8d011c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:42:33 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:42:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:33 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c 1073741824 Jul 17 05:42:33 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:34 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c 1073741824" returned: 0 in 0.379s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:34 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c Jul 17 05:42:34 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:34 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2f93bd-7922-4f4a-8c71-85d7d5686e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8194351-8f28-4b81-9df7-58e00e8d011c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e9f397-3552-4d5a-9ad1-2cb09cec22a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:42:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Volume volume-b8194351-8f28-4b81-9df7-58e00e8d011c (b8194351-8f28-4b81-9df7-58e00e8d011c): created successfully Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e9f397-3552-4d5a-9ad1-2cb09cec22a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Flow 'volume_create_manager' (c47dc647-9135-4288-95a2-b7d320e35318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:42:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1ade82cd-1eca-4e8c-8a13-dbb7b4e99a78 tempest-ProjectReaderTests-242124027 None] Created volume successfully. Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Acquiring lock "cinder-b8194351-8f28-4b81-9df7-58e00e8d011c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Lock "cinder-b8194351-8f28-4b81-9df7-58e00e8d011c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Acquiring lock "cinder-quobyte-b8194351-8f28-4b81-9df7-58e00e8d011c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Lock "cinder-quobyte-b8194351-8f28-4b81-9df7-58e00e8d011c" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2cd565-081c-493c-8e22-c725b408a3e4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:42:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:34 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c Jul 17 05:42:34 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:35 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:35 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c Jul 17 05:42:35 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:35 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b8194351-8f28-4b81-9df7-58e00e8d011c" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Lock "cinder-quobyte-b8194351-8f28-4b81-9df7-58e00e8d011c" released by "delete_volume" :: held 0.613s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Created reservations ['1f8fb7fd-9070-4697-b511-52fdc718c747', '84e535de-7194-4788-85dd-c6241694b57c', '7968358d-471a-4b8f-aeae-1a44a4a9586d', '512ded9e-9f0d-4e8a-8088-bd309b9ceb75'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:35 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:35 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:35 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Deleted volume successfully. Jul 17 05:42:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-798b5224-30f3-4273-93b6-e62c7264e2d2 tempest-ProjectReaderTests-242124027 None] Lock "cinder-b8194351-8f28-4b81-9df7-58e00e8d011c-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:42:45 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=134,cinder:UPDATE=190,cinder:DELETE=17,cinder:INSERT=51 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:42:45 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=133,cinder:UPDATE=193,cinder:INSERT=47,cinder:DELETE=17 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:42:56 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:42:56 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:42:56 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:42:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Flow 'volume_create_manager' (75149e13-507b-4d11-9631-59fdb6265b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb61cdb-eb75-48e0-8034-958fd07e9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb61cdb-eb75-48e0-8034-958fd07e9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-582453382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9998cfc-5d1c-452b-998c-1ab3fa941401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5397408650e24b3891db8ab317e6964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:03Z,use_quota=True,user_id='be6a2ab8b10648ae8497f370e646d211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24a4039-3101-467b-bd6b-44bb281942f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24a4039-3101-467b-bd6b-44bb281942f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba14f152-3402-4c99-92ec-084c8b58d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba14f152-3402-4c99-92ec-084c8b58d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9998cfc-5d1c-452b-998c-1ab3fa941401', 'volume_name': 'volume-c9998cfc-5d1c-452b-998c-1ab3fa941401', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc35d10-921d-426c-b9b7-036257967a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc35d10-921d-426c-b9b7-036257967a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb18c34c-2a70-44bd-af51-8edb7fd6d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Volume c9998cfc-5d1c-452b-998c-1ab3fa941401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9998cfc-5d1c-452b-998c-1ab3fa941401', 'volume_size': 1} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-582453382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9998cfc-5d1c-452b-998c-1ab3fa941401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5397408650e24b3891db8ab317e6964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:03Z,use_quota=True,user_id='be6a2ab8b10648ae8497f370e646d211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Creating volume c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:03 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 1073741824 Jul 17 05:43:03 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:04 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 1073741824" returned: 0 in 0.410s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:04 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 Jul 17 05:43:04 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:04 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb18c34c-2a70-44bd-af51-8edb7fd6d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9998cfc-5d1c-452b-998c-1ab3fa941401', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b57d3f-3f81-490a-8f94-cb8a1364cc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Volume volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 (c9998cfc-5d1c-452b-998c-1ab3fa941401): created successfully Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b57d3f-3f81-490a-8f94-cb8a1364cc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Flow 'volume_create_manager' (75149e13-507b-4d11-9631-59fdb6265b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-63ed7f63-dd4b-451e-8671-37927bee0d85 tempest-SnapshotDependencyTests-1718389109 None] Created volume successfully. Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Creating offline snapshot 0071ac1c-b390-45c5-878a-ce8391fb7352 of volume c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef4157-4a15-4148-9f43-821a03616e5e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:04 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 Jul 17 05:43:04 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:05 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401" returned: 0 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:05 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 1G Jul 17 05:43:05 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:05 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 1G" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:05 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 Jul 17 05:43:05 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:05 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:05 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 is being set with open permissions: ugo+rw Jul 17 05:43:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:05 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 Jul 17 05:43:05 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:06 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352" returned: 0 in 0.228s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:06 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.info Jul 17 05:43:06 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:06 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.info" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:06 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.info is being set with open permissions: ugo+rw Jul 17 05:43:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:06 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.info Jul 17 05:43:06 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:06 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.info" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a5ffb24-a4ce-4d78-962f-2509db5b57be tempest-SnapshotDependencyTests-1718389109 None] Create snapshot completed successfully Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Flow 'volume_create_manager' (ec7902e6-f3c3-4d6c-a599-5fa636e19927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f26dbdb-cbbf-4c99-9ad5-f5834e1c9544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f26dbdb-cbbf-4c99-9ad5-f5834e1c9544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b28d83-782a-4d95-b753-fe0da64c2a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5397408650e24b3891db8ab317e6964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0071ac1c-b390-45c5-878a-ce8391fb7352,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:07Z,use_quota=True,user_id='be6a2ab8b10648ae8497f370e646d211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15fd366-355e-4194-98ee-466440322dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15fd366-355e-4194-98ee-466440322dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95deb51e-65b0-4ffc-bb30-fc5f8db1215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95deb51e-65b0-4ffc-bb30-fc5f8db1215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60b28d83-782a-4d95-b753-fe0da64c2a97', 'volume_name': 'volume-60b28d83-782a-4d95-b753-fe0da64c2a97', 'volume_size': 1, 'snapshot_id': '0071ac1c-b390-45c5-878a-ce8391fb7352'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb33848a-2fe8-4430-8571-5084ee8aa698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb33848a-2fe8-4430-8571-5084ee8aa698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7b8287-df32-4ea8-8c04-f6211bc7d452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:07 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Volume 60b28d83-782a-4d95-b753-fe0da64c2a97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60b28d83-782a-4d95-b753-fe0da64c2a97', 'volume_size': 1, 'snapshot_id': '0071ac1c-b390-45c5-878a-ce8391fb7352'} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-quobyte-0071ac1c-b390-45c5-878a-ce8391fb7352-60b28d83-782a-4d95-b753-fe0da64c2a97" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-0071ac1c-b390-45c5-878a-ce8391fb7352-60b28d83-782a-4d95-b753-fe0da64c2a97" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Creating volume 60b28d83-782a-4d95-b753-fe0da64c2a97 from snapshot 0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-quobyte-60b28d83-782a-4d95-b753-fe0da64c2a97" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-60b28d83-782a-4d95-b753-fe0da64c2a97" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] snapshot: 0071ac1c-b390-45c5-878a-ce8391fb7352, volume: 60b28d83-782a-4d95-b753-fe0da64c2a97, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8b1d14-6bf1-4f6b-8507-f63616447807]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:07 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 Jul 17 05:43:07 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:07 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352" returned: 0 in 0.346s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9998cfc-5d1c-452b-998c-1ab3fa941401(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c017c26-dc05-4b88-926f-f291fef4951b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:08 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 Jul 17 05:43:08 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:08 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401" returned: 0 in 0.338s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:08 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:43:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:08 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 Jul 17 05:43:08 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:11 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97" returned: 0 in 3.716s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4654f00f-88a6-46a0-a897-547134274dd7]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:12 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 Jul 17 05:43:12 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:12 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401" returned: 0 in 0.494s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401, size 1024.00 MB, duration 3.72 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:43:12 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Converted 1024.00 MB image at 275.44 MB/s Jul 17 05:43:12 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 is being set with open permissions: ugo+rw Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:12 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 Jul 17 05:43:12 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:12 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97" returned: 0 in 0.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-60b28d83-782a-4d95-b753-fe0da64c2a97" released by "_copy_volume_from_snapshot" :: held 5.213s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-0071ac1c-b390-45c5-878a-ce8391fb7352-60b28d83-782a-4d95-b753-fe0da64c2a97" released by "_create_volume_from_snapshot" :: held 5.243s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.256s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7b8287-df32-4ea8-8c04-f6211bc7d452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b28d83-782a-4d95-b753-fe0da64c2a97', 'volume_size': 1, 'snapshot_id': '0071ac1c-b390-45c5-878a-ce8391fb7352'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b043e3-8f0c-441b-bf17-546447790475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Volume volume-60b28d83-782a-4d95-b753-fe0da64c2a97 (60b28d83-782a-4d95-b753-fe0da64c2a97): created successfully Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b043e3-8f0c-441b-bf17-546447790475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Flow 'volume_create_manager' (ec7902e6-f3c3-4d6c-a599-5fa636e19927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-006ef407-d434-4c75-8242-6d9f80b03519 tempest-SnapshotDependencyTests-1718389109 None] Created volume successfully. Jul 17 05:43:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-0071ac1c-b390-45c5-878a-ce8391fb7352-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-0071ac1c-b390-45c5-878a-ce8391fb7352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-quobyte-c9998cfc-5d1c-452b-998c-1ab3fa941401" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-c9998cfc-5d1c-452b-998c-1ab3fa941401" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-quobyte-0071ac1c-b390-45c5-878a-ce8391fb7352" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-0071ac1c-b390-45c5-878a-ce8391fb7352" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Deleting offline snapshot 0071ac1c-b390-45c5-878a-ce8391fb7352 of volume c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] snapshot_file for this snap is: volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9e56ec-5dcc-431c-969d-a9607f4cf935]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:14 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 Jul 17 05:43:14 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:14 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9998cfc-5d1c-452b-998c-1ab3fa941401(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0070724-6975-49d9-a352-40399b46132e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:14 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 Jul 17 05:43:14 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:14 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:14 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 Jul 17 05:43:14 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:15 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:15 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352 Jul 17 05:43:15 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:15 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401.0071ac1c-b390-45c5-878a-ce8391fb7352" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-0071ac1c-b390-45c5-878a-ce8391fb7352" released by "_delete_snapshot" :: held 1.315s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-c9998cfc-5d1c-452b-998c-1ab3fa941401" released by "delete_snapshot" :: held 1.337s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Created reservations ['e8472636-e30f-42f7-b38e-8744e362b60c', '77de743f-56be-4352-9206-5ee67fbe6866', 'bfb066f4-c8b7-473e-adc0-e86746277b80', '66dafb4f-db6a-4e30-9e01-65bdd0a734a0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Delete snapshot completed successfully. Jul 17 05:43:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-06d7d69f-f99a-4153-923c-fb0360995009 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-0071ac1c-b390-45c5-878a-ce8391fb7352-delete_snapshot" released by "delete_snapshot" :: held 1.464s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-c9998cfc-5d1c-452b-998c-1ab3fa941401-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-c9998cfc-5d1c-452b-998c-1ab3fa941401-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-quobyte-c9998cfc-5d1c-452b-998c-1ab3fa941401" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-c9998cfc-5d1c-452b-998c-1ab3fa941401" acquired by "delete_volume" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a300f9d0-1bb5-4816-801d-fd0f3e0fc1c9]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:16 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 Jul 17 05:43:16 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:16 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401" returned: 0 in 0.352s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:16 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401 Jul 17 05:43:16 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:16 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c9998cfc-5d1c-452b-998c-1ab3fa941401" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-c9998cfc-5d1c-452b-998c-1ab3fa941401" released by "delete_volume" :: held 0.650s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Created reservations ['a0607461-b5ca-4e68-9add-e4c51aa9feec', 'cc7aba51-15cb-4347-a656-90ed5f7c0a7b', '9daf45ab-eb16-49fe-bb5e-a8c3f52ef653', 'b67ee035-357a-4230-9c1d-f84dfa3f9aad'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:16 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:16 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:17 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.230s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Deleted volume successfully. Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7594e67b-1af4-4d7a-9815-8955d8c92a6b tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-c9998cfc-5d1c-452b-998c-1ab3fa941401-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-60b28d83-782a-4d95-b753-fe0da64c2a97-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-60b28d83-782a-4d95-b753-fe0da64c2a97-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "cinder-quobyte-60b28d83-782a-4d95-b753-fe0da64c2a97" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-60b28d83-782a-4d95-b753-fe0da64c2a97" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[51defb58-3986-4607-944d-cf6f788a766b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:17 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 Jul 17 05:43:17 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:17 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:17 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97 Jul 17 05:43:17 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:17 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-60b28d83-782a-4d95-b753-fe0da64c2a97" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-quobyte-60b28d83-782a-4d95-b753-fe0da64c2a97" released by "delete_volume" :: held 0.650s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Created reservations ['909f3483-e6c1-45f1-97bf-770a4d45980c', 'dfaeee60-7c05-4e22-91cd-3af884ae3f71', 'ffc85fc8-c04a-4751-9c74-04cc9bdd686c', 'fa97195a-be89-4bc7-a88e-b21b09e6551b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:18 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:18 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:18 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.227s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Deleted volume successfully. Jul 17 05:43:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0b08bd55-3338-41c6-935a-8a25b4ac08c6 tempest-SnapshotDependencyTests-1718389109 None] Lock "cinder-60b28d83-782a-4d95-b753-fe0da64c2a97-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:28 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:43:28 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=36,cinder:SELECT=24,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (90d8565f-132c-4c89-a4c3-0eac9185cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46514958-eda2-407f-8649-8516d9def621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46514958-eda2-407f-8649-8516d9def621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226917075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5441adec-d037-4831-b982-f2f7440cebca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:37Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ebb715-5875-4d93-be4b-7b7d212ba5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ebb715-5875-4d93-be4b-7b7d212ba5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bc1e0b-f210-4d18-a3dc-35f25b1471f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bc1e0b-f210-4d18-a3dc-35f25b1471f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5441adec-d037-4831-b982-f2f7440cebca', 'volume_name': 'volume-5441adec-d037-4831-b982-f2f7440cebca', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e17093-5847-4860-b6eb-57d63a149112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e17093-5847-4860-b6eb-57d63a149112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e03a485-c526-4804-9abc-b103b66cc3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:36 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Volume 5441adec-d037-4831-b982-f2f7440cebca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5441adec-d037-4831-b982-f2f7440cebca', 'volume_size': 1} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226917075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5441adec-d037-4831-b982-f2f7440cebca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:37Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Creating volume 5441adec-d037-4831-b982-f2f7440cebca {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:36 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:37 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca 1073741824 Jul 17 05:43:37 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (550d5a02-1352-413e-bdf6-30bdaf0fdb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d80f9ac-94a8-4cd9-830b-e5b1d254ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d80f9ac-94a8-4cd9-830b-e5b1d254ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306665387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bc1c40-0529-45bd-92a7-b04d0aaf9fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:37Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d9ca9d-903a-4bb4-b8e6-1fb50c6a6783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d9ca9d-903a-4bb4-b8e6-1fb50c6a6783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fed318-3879-4942-bf91-7c9dad4002d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fed318-3879-4942-bf91-7c9dad4002d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71bc1c40-0529-45bd-92a7-b04d0aaf9fd1', 'volume_name': 'volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f50dd77-8d96-4082-8476-40935f0101e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f50dd77-8d96-4082-8476-40935f0101e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cc6e03-a72e-4c9b-b454-d9d6536b4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume 71bc1c40-0529-45bd-92a7-b04d0aaf9fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1', 'volume_size': 1} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (0237f12c-961e-49ee-a30d-8196bd017bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44f90e-35e1-4f02-a3c4-3d6050932223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44f90e-35e1-4f02-a3c4-3d6050932223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655844400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4592f98-ad57-4f2d-b292-5197e1931981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:37Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c2c693-33ce-42f1-9305-a2a62553604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c2c693-33ce-42f1-9305-a2a62553604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e1135-abfe-44a7-8f1d-3ec62d1bdf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e1135-abfe-44a7-8f1d-3ec62d1bdf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4592f98-ad57-4f2d-b292-5197e1931981', 'volume_name': 'volume-a4592f98-ad57-4f2d-b292-5197e1931981', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18931e6-f6dd-4d22-83cc-a00305480c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18931e6-f6dd-4d22-83cc-a00305480c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed059e7f-b926-4b59-9621-b4e062e4e2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Volume a4592f98-ad57-4f2d-b292-5197e1931981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4592f98-ad57-4f2d-b292-5197e1931981', 'volume_size': 1} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Flow 'volume_create_manager' (028313f0-490b-43fe-9e92-61dba25a56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25bb264-7e6a-4d91-89b6-0d142f11416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25bb264-7e6a-4d91-89b6-0d142f11416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1229078394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6203857c-e63a-4fcb-8550-2134a3225bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd6ddb03ac418aa4e452305f355d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:38Z,use_quota=True,user_id='a991879ecdd74a31a0bfaec3a515ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbd38c6-824f-4f01-bed1-246d35c21e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbd38c6-824f-4f01-bed1-246d35c21e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a7da7e-cf93-4274-ad0a-4d3bc51f5e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a7da7e-cf93-4274-ad0a-4d3bc51f5e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6203857c-e63a-4fcb-8550-2134a3225bdc', 'volume_name': 'volume-6203857c-e63a-4fcb-8550-2134a3225bdc', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea170813-770b-4f48-a5e8-402822970288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea170813-770b-4f48-a5e8-402822970288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b517716f-1369-4454-939b-25a54fc948bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Volume 6203857c-e63a-4fcb-8550-2134a3225bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6203857c-e63a-4fcb-8550-2134a3225bdc', 'volume_size': 1} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca 1073741824" returned: 0 in 0.717s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (9fc84f4e-6270-4c54-ae03-cfeeda33eb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c463c4-673e-425e-a94c-609eb5cc49be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:37 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca Jul 17 05:43:37 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c463c4-673e-425e-a94c-609eb5cc49be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266111140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4dc40b-fae3-496c-ba69-94af3f5bd170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:38Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f40535-8f26-4ce0-a362-aac37d8d8b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f40535-8f26-4ce0-a362-aac37d8d8b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ae5a39-d6e9-46b4-afda-02fc94bdb4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ae5a39-d6e9-46b4-afda-02fc94bdb4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4dc40b-fae3-496c-ba69-94af3f5bd170', 'volume_name': 'volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21b2fe4-70d7-435d-b60e-030f8ec73cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21b2fe4-70d7-435d-b60e-030f8ec73cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b114c95e-ede7-4010-b928-e69035b4ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Volume 5e4dc40b-fae3-496c-ba69-94af3f5bd170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170', 'volume_size': 1} Jul 17 05:43:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:38 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306665387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bc1c40-0529-45bd-92a7-b04d0aaf9fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:37Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Creating volume 71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:38 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e03a485-c526-4804-9abc-b103b66cc3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5441adec-d037-4831-b982-f2f7440cebca', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a9e9cc-ccdf-400a-bfdc-723e1d3880e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 1073741824 Jul 17 05:43:38 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Volume volume-5441adec-d037-4831-b982-f2f7440cebca (5441adec-d037-4831-b982-f2f7440cebca): created successfully Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a9e9cc-ccdf-400a-bfdc-723e1d3880e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (90d8565f-132c-4c89-a4c3-0eac9185cf18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-96860d7a-916f-4619-849a-9a3be2040290 tempest-CreateVolumesFromImageTest-1537482213 None] Created volume successfully. Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (8d4f1f71-a581-43ca-839c-6b6b43ba6058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bed9f7-81b8-4830-a0d0-623f8b5e1d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bed9f7-81b8-4830-a0d0-623f8b5e1d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257046298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca49844-b2f4-4938-8cbf-6ce80716235a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:38Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a354890-5204-4a96-b7df-c70c806ae12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a354890-5204-4a96-b7df-c70c806ae12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eba3e3-8813-42ef-82a1-1fd8d8d861a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eba3e3-8813-42ef-82a1-1fd8d8d861a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca49844-b2f4-4938-8cbf-6ce80716235a', 'volume_name': 'volume-dca49844-b2f4-4938-8cbf-6ce80716235a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5b96bb-4693-458e-8879-59f62c9badac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5b96bb-4693-458e-8879-59f62c9badac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29fbe48-a8b4-4c00-ba5c-0b9908e13d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Volume dca49844-b2f4-4938-8cbf-6ce80716235a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca49844-b2f4-4938-8cbf-6ce80716235a', 'volume_size': 1} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:38 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 1073741824" returned: 0 in 0.604s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (7d05b40c-6b2d-4e01-aecc-4b991d06ce42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9143b9a1-13f3-43bc-89e8-54c43401b62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9143b9a1-13f3-43bc-89e8-54c43401b62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899367149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:39Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b860650-26c2-4da4-bc3d-edaaa832069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b860650-26c2-4da4-bc3d-edaaa832069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ffdb46-069d-49c0-9b48-9cd5b75907f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ffdb46-069d-49c0-9b48-9cd5b75907f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9', 'volume_name': 'volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a38f10-6892-4870-ae71-6d22f9dce331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a38f10-6892-4870-ae71-6d22f9dce331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a4f918-7b30-4583-a32e-7ee316215a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Volume 82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9', 'volume_size': 1} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:38 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 Jul 17 05:43:38 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:39 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655844400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4592f98-ad57-4f2d-b292-5197e1931981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:37Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Creating volume a4592f98-ad57-4f2d-b292-5197e1931981 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:39 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 1073741824 Jul 17 05:43:39 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cc6e03-a72e-4c9b-b454-d9d6536b4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ac2fbe-b7e7-4a52-837e-a510b67093a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 (71bc1c40-0529-45bd-92a7-b04d0aaf9fd1): created successfully Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ac2fbe-b7e7-4a52-837e-a510b67093a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (550d5a02-1352-413e-bdf6-30bdaf0fdb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9ff91a4d-c340-44f7-a924-df027bb96b8a tempest-CreateVolumesFromSnapshotTest-399724468 None] Created volume successfully. Jul 17 05:43:39 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 1073741824" returned: 0 in 0.494s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:39 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 Jul 17 05:43:39 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:39 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.224s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1229078394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6203857c-e63a-4fcb-8550-2134a3225bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd6ddb03ac418aa4e452305f355d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:38Z,use_quota=True,user_id='a991879ecdd74a31a0bfaec3a515ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Creating volume 6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed059e7f-b926-4b59-9621-b4e062e4e2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4592f98-ad57-4f2d-b292-5197e1931981', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4c4794-57ba-4d30-ae1b-5e7a8707056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:39 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc 1073741824 Jul 17 05:43:39 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Volume volume-a4592f98-ad57-4f2d-b292-5197e1931981 (a4592f98-ad57-4f2d-b292-5197e1931981): created successfully Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4c4794-57ba-4d30-ae1b-5e7a8707056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (0237f12c-961e-49ee-a30d-8196bd017bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-51800152-c1ea-496a-8cd7-f74fc11e077f tempest-CreateVolumesFromImageTest-1537482213 None] Created volume successfully. Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:40 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc 1073741824" returned: 0 in 0.645s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:40 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc Jul 17 05:43:40 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:40 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266111140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4dc40b-fae3-496c-ba69-94af3f5bd170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:38Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Creating volume 5e4dc40b-fae3-496c-ba69-94af3f5bd170 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:40 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b517716f-1369-4454-939b-25a54fc948bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6203857c-e63a-4fcb-8550-2134a3225bdc', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:40 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 1073741824 Jul 17 05:43:40 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29965cf-c04d-43ed-b282-dee0e1cab3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Volume volume-6203857c-e63a-4fcb-8550-2134a3225bdc (6203857c-e63a-4fcb-8550-2134a3225bdc): created successfully Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29965cf-c04d-43ed-b282-dee0e1cab3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Flow 'volume_create_manager' (028313f0-490b-43fe-9e92-61dba25a56db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-42192153-3aa1-402c-a0cc-cd6311a80dc3 tempest-VolumeDependencyTests-285925982 None] Created volume successfully. Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:41 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Flow 'volume_create_manager' (cb434b16-350c-4617-9fd1-19d45050015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077e1071-4514-48af-af8b-0118f7c9f416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 1073741824" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077e1071-4514-48af-af8b-0118f7c9f416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a5af53-424b-483c-ab47-c20562efb4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5aa59ab36e44288340ec7c1351be85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:41Z,use_quota=True,user_id='0dc0c59e38a34d0a8560d45b13fd048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(853d4e41-517d-4002-8708-67881241596e),volume_type_id=853d4e41-517d-4002-8708-67881241596e)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ced7242-1ddf-40eb-bfff-0d587ffb9a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ced7242-1ddf-40eb-bfff-0d587ffb9a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33687571-ec5b-4a5b-9a8b-63ce77ef5566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:41 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 Jul 17 05:43:41 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33687571-ec5b-4a5b-9a8b-63ce77ef5566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1a5af53-424b-483c-ab47-c20562efb4d9', 'volume_name': 'volume-e1a5af53-424b-483c-ab47-c20562efb4d9', 'volume_size': 1, 'image_id': '55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00eea648fa3bfc66aef57292b96940c2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df5aa59ab36e44288340ec7c1351be85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a461287b1fd334b037016ab37c15d502425503380b5269f4ec1ade3fb0a11983badb24b140118577b30ca97663593ded4dab27601734a56257609aa0f1955b7', 'id': '55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'created_at': datetime.datetime(2026, 7, 17, 3, 43, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 43, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1d6854-31fa-4cb1-8f2e-15764c41ee73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1d6854-31fa-4cb1-8f2e-15764c41ee73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249f68b-bb5d-46bc-8031-64861b330a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Volume e1a5af53-424b-483c-ab47-c20562efb4d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1a5af53-424b-483c-ab47-c20562efb4d9', 'volume_size': 1, 'image_id': '55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00eea648fa3bfc66aef57292b96940c2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df5aa59ab36e44288340ec7c1351be85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a461287b1fd334b037016ab37c15d502425503380b5269f4ec1ade3fb0a11983badb24b140118577b30ca97663593ded4dab27601734a56257609aa0f1955b7', 'id': '55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'created_at': datetime.datetime(2026, 7, 17, 3, 43, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 43, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Trying to clone e1a5af53-424b-483c-ab47-c20562efb4d9 from image 55715fc3-0f24-4464-9efe-1c9c36ffa78c at location (None, [{'url': 'file:///opt/stack/data/glance/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:43:41 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.363s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257046298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca49844-b2f4-4938-8cbf-6ce80716235a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:38Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Creating volume dca49844-b2f4-4938-8cbf-6ce80716235a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:41 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:43:41 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Image download 0.00 MB at 0.00 MB/s Jul 17 05:43:41 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a 1073741824 Jul 17 05:43:41 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b114c95e-ede7-4010-b928-e69035b4ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986bc860-df35-4688-ae56-fd432b3b2698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Volume volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 (5e4dc40b-fae3-496c-ba69-94af3f5bd170): created successfully Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986bc860-df35-4688-ae56-fd432b3b2698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (9fc84f4e-6270-4c54-ae03-cfeeda33eb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4019879-9377-48c4-ad78-e67cec8c8099]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8465fae8-f319-4865-b309-481306bebaed tempest-CreateVolumesFromImageTest-1537482213 None] Created volume successfully. Jul 17 05:43:41 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD Jul 17 05:43:41 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:42 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a 1073741824" returned: 0 in 0.485s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:42 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:42 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a Jul 17 05:43:42 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:42 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD Jul 17 05:43:42 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:42 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.706s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899367149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224c84228f5d4b3faff939bc2185ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:39Z,use_quota=True,user_id='b25fff80a6a344b5875e0f7f6cda475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Creating volume 82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:42 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:42 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Temporary image 55715fc3-0f24-4464-9efe-1c9c36ffa78c is fetched for user 0dc0c59e38a34d0a8560d45b13fd048f. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:43:42 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 1073741824 Jul 17 05:43:42 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29fbe48-a8b4-4c00-ba5c-0b9908e13d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca49844-b2f4-4938-8cbf-6ce80716235a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dcb062-4229-4e44-a726-ee0af689da71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Volume volume-dca49844-b2f4-4938-8cbf-6ce80716235a (dca49844-b2f4-4938-8cbf-6ce80716235a): created successfully Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dcb062-4229-4e44-a726-ee0af689da71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (8d4f1f71-a581-43ca-839c-6b6b43ba6058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eee83142-529e-45c9-bc0d-1932c44a229f tempest-CreateVolumesFromImageTest-1537482213 None] Created volume successfully. Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d450114-dc6d-4ff3-9330-decb64b328f6]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:42 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD Jul 17 05:43:42 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:43 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 1073741824" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:43 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:43 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 Jul 17 05:43:43 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:43 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD Jul 17 05:43:43 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:43 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.820s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Creating offline snapshot 7e9bf4b2-324d-4524-a675-41387d2a4f41 of volume 71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a4f918-7b30-4583-a32e-7ee316215a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dcd600-1a94-41d5-bdbf-c06daf0db6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[17abda01-1c68-4931-801e-d4a68eb4bc0e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Volume volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 (82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9): created successfully Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dcd600-1a94-41d5-bdbf-c06daf0db6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Flow 'volume_create_manager' (7d05b40c-6b2d-4e01-aecc-4b991d06ce42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:43 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:43:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-789c3e80-d961-471e-b95d-d0eccf17232e tempest-CreateVolumesFromImageTest-1537482213 None] Created volume successfully. Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:43 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 Jul 17 05:43:43 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:43 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:43 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 1G Jul 17 05:43:43 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:44 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 1G" returned: 0 in 0.371s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:44 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 Jul 17 05:43:44 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-quobyte-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:44 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:44 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 is being set with open permissions: ugo+rw Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c11e0-82cf-49b3-a311-d3da2b3c79eb]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:44 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 Jul 17 05:43:44 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:44 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 Jul 17 05:43:44 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:44 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:44 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.info Jul 17 05:43:44 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:44 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9" returned: 0 in 0.365s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:44 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9 Jul 17 05:43:44 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:44 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.info" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:44 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.info is being set with open permissions: ugo+rw Jul 17 05:43:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:45 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.info Jul 17 05:43:45 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:45 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9" returned: 0 in 0.240s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9" released by "delete_volume" :: held 0.655s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Created reservations ['6a5394eb-1538-4306-8cc3-b18e7e08b8c5', '1965f9c1-6448-420f-9fe6-894c36aef8bc', '948ef5ea-e8e3-4835-9491-d734d1a2cc30', '5a1d1c97-7635-43d2-a14f-2ef2089ca89f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:45 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:45 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:45 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.info" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.088s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Creating offline snapshot 6677459d-2836-49c7-86cc-a26d1bb7f907 of volume 6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:43:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6a72c64a-cb0c-444e-862b-206a4324e99e tempest-CreateVolumesFromSnapshotTest-399724468 None] Create snapshot completed successfully Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b192ea7-2a46-4bea-bfba-c38a6695c5bd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:45 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc Jul 17 05:43:45 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:45 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Deleted volume successfully. Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d8df5a11-06ea-41f0-9980-dc88db123b6c tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-82a4e30b-f9b3-4f26-bad7-b1d7c34fdbc9-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-dca49844-b2f4-4938-8cbf-6ce80716235a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-dca49844-b2f4-4938-8cbf-6ce80716235a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-quobyte-dca49844-b2f4-4938-8cbf-6ce80716235a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-dca49844-b2f4-4938-8cbf-6ce80716235a" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[274aa76a-ca20-4195-be9c-b846a19c5fcd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:45 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:45 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 1G Jul 17 05:43:45 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:45 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a Jul 17 05:43:45 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:46 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a" returned: 0 in 0.457s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:46 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a Jul 17 05:43:46 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:46 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 1G" returned: 0 in 0.474s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6203857c-e63a-4fcb-8550-2134a3225bdc -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:46 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6203857c-e63a-4fcb-8550-2134a3225bdc -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 Jul 17 05:43:46 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (452b0c50-2350-47b3-80e7-1489c64311ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b697e937-6d0f-4a98-8fdb-5d5153c02931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b697e937-6d0f-4a98-8fdb-5d5153c02931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024487113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b24e4d-64db-4266-aecb-ca652ae27f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:46Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923fab78-24e2-436d-931d-0e42b7e4b745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923fab78-24e2-436d-931d-0e42b7e4b745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c34a2f-d622-4a38-965e-1dd88449d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c34a2f-d622-4a38-965e-1dd88449d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b24e4d-64db-4266-aecb-ca652ae27f55', 'volume_name': 'volume-39b24e4d-64db-4266-aecb-ca652ae27f55', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dfca08-bcd1-47ca-ad20-9f9c45a94fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dfca08-bcd1-47ca-ad20-9f9c45a94fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8341d2-9902-4efb-a8f2-c8addea68806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume 39b24e4d-64db-4266-aecb-ca652ae27f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b24e4d-64db-4266-aecb-ca652ae27f55', 'volume_size': 1} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:46 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-dca49844-b2f4-4938-8cbf-6ce80716235a" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-dca49844-b2f4-4938-8cbf-6ce80716235a" released by "delete_volume" :: held 0.844s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Created reservations ['f88affaa-a9f2-47f4-8cab-abd4af1d9d89', '923099ef-52fb-422d-b128-c3dd09187d43', '8aaa23e5-a798-4ceb-8239-aad26d981a18', '54b85b32-b982-40b2-b10c-a7c2e54ca00e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:46 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6203857c-e63a-4fcb-8550-2134a3225bdc -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:46 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 is being set with open permissions: ugo+rw Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:46 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 Jul 17 05:43:46 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:46 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:46 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (6f0b31c7-a2b7-4b9f-8f94-50898dd36539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561e6dd1-493d-4f24-90d2-ccfa5c6a713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561e6dd1-493d-4f24-90d2-ccfa5c6a713c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-84103436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9989719-b15e-4fed-bca9-f9fbcec8c983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:47Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abce996e-7b47-44a8-aa28-2d0e440aa701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abce996e-7b47-44a8-aa28-2d0e440aa701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3f5bc4-431b-4480-bb55-60c18364f810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3f5bc4-431b-4480-bb55-60c18364f810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9989719-b15e-4fed-bca9-f9fbcec8c983', 'volume_name': 'volume-b9989719-b15e-4fed-bca9-f9fbcec8c983', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4db75a-9259-4287-8f76-2fad5b9a5903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4db75a-9259-4287-8f76-2fad5b9a5903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15485490-df00-4d67-92a9-43bde8bedc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:46 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume b9989719-b15e-4fed-bca9-f9fbcec8c983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9989719-b15e-4fed-bca9-f9fbcec8c983', 'volume_size': 1} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-5e4dc40b-fae3-496c-ba69-94af3f5bd170-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-5e4dc40b-fae3-496c-ba69-94af3f5bd170-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-quobyte-5e4dc40b-fae3-496c-ba69-94af3f5bd170" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-5e4dc40b-fae3-496c-ba69-94af3f5bd170" acquired by "delete_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc4b0ee-e3ba-4a52-9c94-59f7399e97b5]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:46 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:46 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Deleted volume successfully. Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f039dead-5fd1-4fb1-a7a8-3f7c3987b52d tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-dca49844-b2f4-4938-8cbf-6ce80716235a-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:47 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:47 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 Jul 17 05:43:47 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:47 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.info Jul 17 05:43:47 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (1667796a-709c-4cb1-9499-a21fd47b9f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28933345-94fa-4e71-80fd-73e7cf397c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28933345-94fa-4e71-80fd-73e7cf397c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312685822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e9e0d9-ba01-4984-9749-b822b301c02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:47Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4eca1c9-fafc-46bb-b376-870ef6d50b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4eca1c9-fafc-46bb-b376-870ef6d50b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd357b9b-6bce-49cb-8e32-61b46e934253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd357b9b-6bce-49cb-8e32-61b46e934253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e9e0d9-ba01-4984-9749-b822b301c02d', 'volume_name': 'volume-92e9e0d9-ba01-4984-9749-b822b301c02d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fe7db5-52eb-4dc9-8f30-580617f12113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fe7db5-52eb-4dc9-8f30-580617f12113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e567fd6-c53c-4e20-8b8f-11e5f344d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume 92e9e0d9-ba01-4984-9749-b822b301c02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e9e0d9-ba01-4984-9749-b822b301c02d', 'volume_size': 1} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:47 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170" returned: 0 in 0.485s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:47 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170 Jul 17 05:43:47 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:47 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.info" returned: 0 in 0.457s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:47 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.info is being set with open permissions: ugo+rw Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:47 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.info Jul 17 05:43:47 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (73a1b8df-2804-4111-91ec-5543151dbc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17252f25-429e-4a38-aec7-20d9b4602b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17252f25-429e-4a38-aec7-20d9b4602b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686187454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba2dc71-e147-4321-b5e6-3763fd06c8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:48Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2daceb5-1419-448b-a85d-6527469fefa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2daceb5-1419-448b-a85d-6527469fefa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c7607a-0292-4b7d-b3c9-24280800c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c7607a-0292-4b7d-b3c9-24280800c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba2dc71-e147-4321-b5e6-3763fd06c8f1', 'volume_name': 'volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e1243b-8b71-406d-aa1c-587753f6f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e1243b-8b71-406d-aa1c-587753f6f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc7e629-5454-4019-9e0b-256e1c76852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:47 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume bba2dc71-e147-4321-b5e6-3763fd06c8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1', 'volume_size': 1} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5e4dc40b-fae3-496c-ba69-94af3f5bd170" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-5e4dc40b-fae3-496c-ba69-94af3f5bd170" released by "delete_volume" :: held 0.878s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Created reservations ['c7e29c4d-c0de-46a7-aa78-5fb765ad84b0', 'dbc44c74-0840-44ea-b9da-81311651ff8e', '489747e9-5d8d-445e-904d-7ef6d872ee3a', '6e78b4a9-1024-4867-8ee2-93e92d8d5e68'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:47 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.info" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.535s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a5af53-424b-483c-ab47-c20562efb4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5aa59ab36e44288340ec7c1351be85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:41Z,use_quota=True,user_id='0dc0c59e38a34d0a8560d45b13fd048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(853d4e41-517d-4002-8708-67881241596e),volume_type_id=853d4e41-517d-4002-8708-67881241596e)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Creating volume e1a5af53-424b-483c-ab47-c20562efb4d9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:47 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:47 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 1073741824 Jul 17 05:43:47 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a47b7aab-7e21-48be-b3df-10f328330661 tempest-VolumeDependencyTests-285925982 None] Create snapshot completed successfully Jul 17 05:43:48 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:48 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-a4592f98-ad57-4f2d-b292-5197e1931981-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (08f68f31-f38a-4a57-9b4a-472d368c4679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6484ffba-c8d9-4cb2-ae4a-14c6f72100b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6484ffba-c8d9-4cb2-ae4a-14c6f72100b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843206512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e479ba-9387-4caf-a7cc-91ca1269c1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:48Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db0381d-dc62-4d7d-be52-746d19d6f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db0381d-dc62-4d7d-be52-746d19d6f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4293289-80b5-43c2-9ad8-5f67007964f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4293289-80b5-43c2-9ad8-5f67007964f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e479ba-9387-4caf-a7cc-91ca1269c1ed', 'volume_name': 'volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70634d5d-0fd0-4641-bdbf-91fa88faf85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70634d5d-0fd0-4641-bdbf-91fa88faf85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6a0814-6a6f-4598-bcaa-38533f975d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume c5e479ba-9387-4caf-a7cc-91ca1269c1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed', 'volume_size': 1} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-a4592f98-ad57-4f2d-b292-5197e1931981-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-quobyte-a4592f98-ad57-4f2d-b292-5197e1931981" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-a4592f98-ad57-4f2d-b292-5197e1931981" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd3d39-a506-46c2-ac7e-5430b37df108]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:48 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.312s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Deleted volume successfully. Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f363b1a9-0484-46fc-a3bb-f1b54a0f81f3 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-5e4dc40b-fae3-496c-ba69-94af3f5bd170-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:48 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 Jul 17 05:43:48 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:48 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 1073741824" returned: 0 in 0.516s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:48 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 Jul 17 05:43:48 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:48 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:48 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981 Jul 17 05:43:48 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:48 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.472s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024487113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b24e4d-64db-4266-aecb-ca652ae27f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:46Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Creating volume 39b24e4d-64db-4266-aecb-ca652ae27f55 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:48 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 1073741824 Jul 17 05:43:48 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Attempting download of 55715fc3-0f24-4464-9efe-1c9c36ffa78c ((None, [{'url': 'file:///opt/stack/data/glance/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'metadata': {}}])) to volume e1a5af53-424b-483c-ab47-c20562efb4d9. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:43:48 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0ec820-ca06-4f3e-be5d-fa7c987f5316]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55715fc3-0f24-4464-9efe-1c9c36ffa78c_xdlydvyo {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-a4592f98-ad57-4f2d-b292-5197e1931981" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-a4592f98-ad57-4f2d-b292-5197e1931981" released by "delete_volume" :: held 0.761s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Created reservations ['00315f8b-35f8-436e-b9ea-d0b1a062d06a', '84bff1af-25e3-49c4-914e-ae7cdda08aad', 'b2ec3e81-73d0-474d-a9db-54ac0e824408', '69f83184-80b9-414b-9638-cd7e54071c55'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:49 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55715fc3-0f24-4464-9efe-1c9c36ffa78c_xdlydvyo Jul 17 05:43:49 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:49 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:49 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Flow 'volume_create_manager' (65629128-467c-4175-868b-5e3f1ef1eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe46649-7705-4fce-962a-f841af1ab368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-5441adec-d037-4831-b982-f2f7440cebca-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe46649-7705-4fce-962a-f841af1ab368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1275922150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935bed72-b03b-472f-91a7-aa7113272f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd6ddb03ac418aa4e452305f355d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6677459d-2836-49c7-86cc-a26d1bb7f907,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:49Z,use_quota=True,user_id='a991879ecdd74a31a0bfaec3a515ca6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a980c3-9d09-43c4-9e8d-413cd24e0b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a980c3-9d09-43c4-9e8d-413cd24e0b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cd6d63-0c48-441a-abf4-98837980bdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cd6d63-0c48-441a-abf4-98837980bdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '935bed72-b03b-472f-91a7-aa7113272f51', 'volume_name': 'volume-935bed72-b03b-472f-91a7-aa7113272f51', 'volume_size': 1, 'snapshot_id': '6677459d-2836-49c7-86cc-a26d1bb7f907'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0727267-ede4-41dd-80d1-a099e167334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0727267-ede4-41dd-80d1-a099e167334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888c9eb4-4299-4885-8eb1-e6f1da805247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Volume 935bed72-b03b-472f-91a7-aa7113272f51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-935bed72-b03b-472f-91a7-aa7113272f51', 'volume_size': 1, 'snapshot_id': '6677459d-2836-49c7-86cc-a26d1bb7f907'} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-5441adec-d037-4831-b982-f2f7440cebca-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:49 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55715fc3-0f24-4464-9efe-1c9c36ffa78c_xdlydvyo" returned: 0 in 0.485s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55715fc3-0f24-4464-9efe-1c9c36ffa78c_xdlydvyo {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:49 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 1073741824" returned: 0 in 0.652s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "cinder-quobyte-5441adec-d037-4831-b982-f2f7440cebca" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-5441adec-d037-4831-b982-f2f7440cebca" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:49 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.380s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddb4ce1-1883-4d80-bd2d-95e5ea010891]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:49 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 Jul 17 05:43:49 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Deleted volume successfully. Jul 17 05:43:49 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55715fc3-0f24-4464-9efe-1c9c36ffa78c_xdlydvyo Jul 17 05:43:49 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ffee7e67-038c-41ed-91bc-2148cb480562 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-a4592f98-ad57-4f2d-b292-5197e1931981-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:49 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca Jul 17 05:43:49 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:49 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.025s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-84103436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9989719-b15e-4fed-bca9-f9fbcec8c983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:47Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:49 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Creating volume b9989719-b15e-4fed-bca9-f9fbcec8c983 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:49 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8341d2-9902-4efb-a8f2-c8addea68806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b24e4d-64db-4266-aecb-ca652ae27f55', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ded8d-df19-45dc-ac3c-bab89b12c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:49 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 1073741824 Jul 17 05:43:49 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55715fc3-0f24-4464-9efe-1c9c36ffa78c_xdlydvyo" returned: 1 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55715fc3-0f24-4464-9efe-1c9c36ffa78c_xdlydvyo' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a004adb-98cf-42c3-b415-f70b34756a46]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume volume-39b24e4d-64db-4266-aecb-ca652ae27f55 (39b24e4d-64db-4266-aecb-ca652ae27f55): created successfully Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ded8d-df19-45dc-ac3c-bab89b12c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (452b0c50-2350-47b3-80e7-1489c64311ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e9b29dfa-b988-4676-a9bb-1fa6d63db854 tempest-CreateVolumesFromSnapshotTest-399724468 None] Created volume successfully. Jul 17 05:43:49 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD Jul 17 05:43:49 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:49 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca" returned: 0 in 0.429s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:50 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca Jul 17 05:43:50 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:50 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:50 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-5441adec-d037-4831-b982-f2f7440cebca" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:50 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 1073741824" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-quobyte-5441adec-d037-4831-b982-f2f7440cebca" released by "delete_volume" :: held 0.785s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:50 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD Jul 17 05:43:50 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:50 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 Jul 17 05:43:50 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Created reservations ['2d80b3ad-f4d3-4001-8f4e-32528285a516', '8d747fce-1bc6-468a-a2c6-6f5ce35ab209', 'e44e0304-f8a7-49a8-ad24-e40af12d353b', '95a1be12-6adf-47d7-838f-9cf02aaa2e70'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:50 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:50 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:50 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] 55715fc3-0f24-4464-9efe-1c9c36ffa78c was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:50 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:50 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.253s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:50 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312685822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e9e0d9-ba01-4984-9749-b822b301c02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:47Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Creating volume 92e9e0d9-ba01-4984-9749-b822b301c02d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:50 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:50 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d 1073741824 Jul 17 05:43:50 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15485490-df00-4d67-92a9-43bde8bedc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9989719-b15e-4fed-bca9-f9fbcec8c983', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c1e4a6-8b74-4eea-a163-49691da38857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 (b9989719-b15e-4fed-bca9-f9fbcec8c983): created successfully Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c1e4a6-8b74-4eea-a163-49691da38857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (6f0b31c7-a2b7-4b9f-8f94-50898dd36539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-66af84fb-ee45-4a10-b339-549e9129e96a tempest-CreateVolumesFromSnapshotTest-399724468 None] Created volume successfully. Jul 17 05:43:50 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Deleted volume successfully. Jul 17 05:43:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8d6b3252-2f52-4f19-9bc4-78ad655e1d07 tempest-CreateVolumesFromImageTest-1537482213 None] Lock "cinder-5441adec-d037-4831-b982-f2f7440cebca-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:51 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9" returned: 0 in 0.505s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55715fc3-0f24-4464-9efe-1c9c36ffa78c_jz9d406_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:43:51 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:51 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 1G Jul 17 05:43:51 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:51 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d 1073741824" returned: 0 in 0.551s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:51 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d Jul 17 05:43:51 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:51 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 1G" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Downloaded image 55715fc3-0f24-4464-9efe-1c9c36ffa78c ((None, [{'url': 'file:///opt/stack/data/glance/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'metadata': {}}])) to volume e1a5af53-424b-483c-ab47-c20562efb4d9 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Temporary image 55715fc3-0f24-4464-9efe-1c9c36ffa78c for user 0dc0c59e38a34d0a8560d45b13fd048f is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Marking volume e1a5af53-424b-483c-ab47-c20562efb4d9 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Copying metadata from image 55715fc3-0f24-4464-9efe-1c9c36ffa78c to e1a5af53-424b-483c-ab47-c20562efb4d9. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Creating volume glance metadata for volume e1a5af53-424b-483c-ab47-c20562efb4d9 backed by image 55715fc3-0f24-4464-9efe-1c9c36ffa78c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '00eea648fa3bfc66aef57292b96940c2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:43:51 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d" returned: 0 in 0.329s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.808s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686187454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba2dc71-e147-4321-b5e6-3763fd06c8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:48Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Creating volume bba2dc71-e147-4321-b5e6-3763fd06c8f1 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:51 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:51 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 1073741824 Jul 17 05:43:51 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e567fd6-c53c-4e20-8b8f-11e5f344d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e9e0d9-ba01-4984-9749-b822b301c02d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db0d286-adaa-4f4f-ba75-49f28cb1f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume volume-92e9e0d9-ba01-4984-9749-b822b301c02d (92e9e0d9-ba01-4984-9749-b822b301c02d): created successfully Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db0d286-adaa-4f4f-ba75-49f28cb1f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (1667796a-709c-4cb1-9499-a21fd47b9f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1ef15d69-c95e-427d-be49-844c6aa7028f tempest-CreateVolumesFromSnapshotTest-399724468 None] Created volume successfully. Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249f68b-bb5d-46bc-8031-64861b330a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a5af53-424b-483c-ab47-c20562efb4d9', 'volume_size': 1, 'image_id': '55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00eea648fa3bfc66aef57292b96940c2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df5aa59ab36e44288340ec7c1351be85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a461287b1fd334b037016ab37c15d502425503380b5269f4ec1ade3fb0a11983badb24b140118577b30ca97663593ded4dab27601734a56257609aa0f1955b7', 'id': '55715fc3-0f24-4464-9efe-1c9c36ffa78c', 'created_at': datetime.datetime(2026, 7, 17, 3, 43, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 43, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55715fc3-0f24-4464-9efe-1c9c36ffa78c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6379ecf0-7e59-48eb-9797-1b0071cdf25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Volume volume-e1a5af53-424b-483c-ab47-c20562efb4d9 (e1a5af53-424b-483c-ab47-c20562efb4d9): created successfully Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6379ecf0-7e59-48eb-9797-1b0071cdf25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Flow 'volume_create_manager' (cb434b16-350c-4617-9fd1-19d45050015a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-433c7622-25f1-40c8-b033-65b377fafb88 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Created volume successfully. Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Acquiring lock "cinder-e1a5af53-424b-483c-ab47-c20562efb4d9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "cinder-e1a5af53-424b-483c-ab47-c20562efb4d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:52 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 1073741824" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Acquiring lock "cinder-quobyte-e1a5af53-424b-483c-ab47-c20562efb4d9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "cinder-quobyte-e1a5af53-424b-483c-ab47-c20562efb4d9" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:52 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 Jul 17 05:43:52 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1cd44c-4a26-4305-b8ce-36fbee9b1c46]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:52 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 Jul 17 05:43:52 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:52 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1" returned: 0 in 0.305s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.329s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843206512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e479ba-9387-4caf-a7cc-91ca1269c1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a466b1163c47538b666d39226d8d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:48Z,use_quota=True,user_id='287fcc97c9244563af81eac1e78aebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Creating volume c5e479ba-9387-4caf-a7cc-91ca1269c1ed {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:52 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed 1073741824 Jul 17 05:43:52 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc7e629-5454-4019-9e0b-256e1c76852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d42514-9019-4c44-bd4b-c3ec08e54d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 (bba2dc71-e147-4321-b5e6-3763fd06c8f1): created successfully Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d42514-9019-4c44-bd4b-c3ec08e54d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (73a1b8df-2804-4111-91ec-5543151dbc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b4032fd3-e93e-477e-88ef-544fd2e4a07a tempest-CreateVolumesFromSnapshotTest-399724468 None] Created volume successfully. Jul 17 05:43:52 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9" returned: 0 in 0.463s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:52 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9 Jul 17 05:43:52 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:53 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed 1073741824" returned: 0 in 0.478s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:53 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e1a5af53-424b-483c-ab47-c20562efb4d9" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "cinder-quobyte-e1a5af53-424b-483c-ab47-c20562efb4d9" released by "delete_volume" :: held 0.816s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:53 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed Jul 17 05:43:53 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Created reservations ['d46a5e9a-ae45-41c5-bd7e-e9c36bf857b3', '0bd966ab-3896-476f-8973-d5fadd4c7891', '5d0e28c3-eafa-4f39-875f-f2288577cb51', '47594ccd-a52d-49d0-b223-dbdf600bde15'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:53 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:53 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:53 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.942s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-quobyte-6677459d-2836-49c7-86cc-a26d1bb7f907-935bed72-b03b-472f-91a7-aa7113272f51" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6a0814-6a6f-4598-bcaa-38533f975d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05465c60-f6dc-47ad-ad48-2114cfa0510c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Volume volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed (c5e479ba-9387-4caf-a7cc-91ca1269c1ed): created successfully Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05465c60-f6dc-47ad-ad48-2114cfa0510c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Flow 'volume_create_manager' (08f68f31-f38a-4a57-9b4a-472d368c4679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6677459d-2836-49c7-86cc-a26d1bb7f907-935bed72-b03b-472f-91a7-aa7113272f51" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Creating volume 935bed72-b03b-472f-91a7-aa7113272f51 from snapshot 6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-quobyte-935bed72-b03b-472f-91a7-aa7113272f51" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-470c9384-0452-49ef-81f5-8069dffeb3af tempest-CreateVolumesFromSnapshotTest-399724468 None] Created volume successfully. Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-935bed72-b03b-472f-91a7-aa7113272f51" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] snapshot: 6677459d-2836-49c7-86cc-a26d1bb7f907, volume: 935bed72-b03b-472f-91a7-aa7113272f51, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01e27f8-57d0-4c7b-891f-0d62d9359c39]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:53 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.388s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Deleted volume successfully. Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-027e3d2f-4e12-4954-9cef-bc3e0c622d47 tempest-VolumeAndVolumeTypeFromImageTest-1691669824 None] Lock "cinder-e1a5af53-424b-483c-ab47-c20562efb4d9-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:53 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 Jul 17 05:43:53 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (e549ac68-966d-4787-9eb6-9333fa50f73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5655d49b-9385-4178-8bcb-a4afa7674462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-c5e479ba-9387-4caf-a7cc-91ca1269c1ed-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5655d49b-9385-4178-8bcb-a4afa7674462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-280773668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc367d82-50c5-4a9c-845e-6e42c0b9bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:54Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cee847-cae0-42b1-be42-a5373cf0f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cee847-cae0-42b1-be42-a5373cf0f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e163652d-8421-4826-90d9-7246479cf4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e163652d-8421-4826-90d9-7246479cf4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc367d82-50c5-4a9c-845e-6e42c0b9bb45', 'volume_name': 'volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a470d455-88f0-48ad-bc09-38ae23e99b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a470d455-88f0-48ad-bc09-38ae23e99b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31c98ab-446c-4d35-a1c7-c57e7e8606c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:43:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume cc367d82-50c5-4a9c-845e-6e42c0b9bb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45', 'volume_size': 1} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-c5e479ba-9387-4caf-a7cc-91ca1269c1ed-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:53 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907" returned: 0 in 0.426s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6203857c-e63a-4fcb-8550-2134a3225bdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:43:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f7b252-a4ae-4052-a949-cd941ca5c1ad]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-c5e479ba-9387-4caf-a7cc-91ca1269c1ed" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-c5e479ba-9387-4caf-a7cc-91ca1269c1ed" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678d39f-b77f-48fb-bb1e-cb4e3bf872b3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:54 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc Jul 17 05:43:54 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:54 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed Jul 17 05:43:54 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:54 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:54 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 Jul 17 05:43:54 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:54 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:54 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed Jul 17 05:43:54 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:54 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c5e479ba-9387-4caf-a7cc-91ca1269c1ed" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-c5e479ba-9387-4caf-a7cc-91ca1269c1ed" released by "delete_volume" :: held 0.887s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Created reservations ['7fb5e61a-1c74-47a4-9608-27a5a06b4652', '3a8d5d41-b3cb-4897-a319-550430cc538a', '2c1bb06a-6b2d-41fd-92bb-8ed0d75fb4ad', '3be9858f-ae0b-40df-8a84-bc76d3c955f2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:55 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:55 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:55 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.504s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Deleted volume successfully. Jul 17 05:43:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1b30478a-42ff-4117-8a75-1e52a9000948 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-c5e479ba-9387-4caf-a7cc-91ca1269c1ed-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-bba2dc71-e147-4321-b5e6-3763fd06c8f1-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-bba2dc71-e147-4321-b5e6-3763fd06c8f1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-bba2dc71-e147-4321-b5e6-3763fd06c8f1" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-bba2dc71-e147-4321-b5e6-3763fd06c8f1" acquired by "delete_volume" :: waited 0.055s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:43:56 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:56 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23eb842-24f3-4fdd-af49-c8d200c26f05]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:43:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:57 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.669s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:57 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:43:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:43:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:43:57 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 Jul 17 05:43:57 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:57 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1" returned: 0 in 1.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:57 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1 Jul 17 05:43:57 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:58 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bba2dc71-e147-4321-b5e6-3763fd06c8f1" returned: 0 in 0.510s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-bba2dc71-e147-4321-b5e6-3763fd06c8f1" released by "delete_volume" :: held 1.901s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:43:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Created reservations ['e7298b73-3018-479c-bd7e-0b9b87bcd127', '34b4a4bb-a188-425f-91d7-43be41c0debc', '6db72108-3374-4510-b6b3-5df336192f2b', 'e0b4553b-d31f-42f9-bb8d-c6cd63032e3f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:43:59 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:43:59 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:43:59 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:43:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Deleted volume successfully. Jul 17 05:43:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e677ef9-a0c5-4bc6-a7e9-5a7d95139df4 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-bba2dc71-e147-4321-b5e6-3763fd06c8f1-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-92e9e0d9-ba01-4984-9749-b822b301c02d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-92e9e0d9-ba01-4984-9749-b822b301c02d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-92e9e0d9-ba01-4984-9749-b822b301c02d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-92e9e0d9-ba01-4984-9749-b822b301c02d" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[06102d18-fea7-4a7a-94b8-3b7aefe1d406]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:00 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51" returned: 0 in 5.821s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93fc0f-a5ae-4d02-88d0-d0721d26a5b0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:00 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d Jul 17 05:44:00 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:00 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc Jul 17 05:44:00 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:00 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:00 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d Jul 17 05:44:00 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:00 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc" returned: 0 in 0.570s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:44:00 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Converted 1024.00 MB image at 175.81 MB/s Jul 17 05:44:00 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:00 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 is being set with open permissions: ugo+rw Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-92e9e0d9-ba01-4984-9749-b822b301c02d" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-92e9e0d9-ba01-4984-9749-b822b301c02d" released by "delete_volume" :: held 0.720s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:00 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 Jul 17 05:44:00 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Created reservations ['0351974c-f14f-40a7-bc72-2b872171f93b', '23a7f068-de64-4b18-b46a-2bbc23451853', '5f0b7c3c-99a8-4eb6-9708-0c5a76712487', '3cd64ff2-7f6a-46fe-a886-4bdde1d2e247'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:01 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:01 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:01 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-935bed72-b03b-472f-91a7-aa7113272f51" released by "_copy_volume_from_snapshot" :: held 7.623s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6677459d-2836-49c7-86cc-a26d1bb7f907-935bed72-b03b-472f-91a7-aa7113272f51" released by "_create_volume_from_snapshot" :: held 7.674s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.741s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.134s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-280773668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc367d82-50c5-4a9c-845e-6e42c0b9bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:43:54Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Creating volume cc367d82-50c5-4a9c-845e-6e42c0b9bb45 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:01 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:01 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 1073741824 Jul 17 05:44:01 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888c9eb4-4299-4885-8eb1-e6f1da805247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935bed72-b03b-472f-91a7-aa7113272f51', 'volume_size': 1, 'snapshot_id': '6677459d-2836-49c7-86cc-a26d1bb7f907'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a088cd-18bb-4137-bf5a-d27e9cd4ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Volume volume-935bed72-b03b-472f-91a7-aa7113272f51 (935bed72-b03b-472f-91a7-aa7113272f51): created successfully Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a088cd-18bb-4137-bf5a-d27e9cd4ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Flow 'volume_create_manager' (65629128-467c-4175-868b-5e3f1ef1eabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9031a1f0-25c7-40b1-bacd-3ceb12234e8a tempest-VolumeDependencyTests-285925982 None] Created volume successfully. Jul 17 05:44:01 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Deleted volume successfully. Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b256c03f-7782-4b9a-80b6-cab80c4cd044 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-92e9e0d9-ba01-4984-9749-b822b301c02d-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-b9989719-b15e-4fed-bca9-f9fbcec8c983-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-6677459d-2836-49c7-86cc-a26d1bb7f907-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-6677459d-2836-49c7-86cc-a26d1bb7f907-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-quobyte-6203857c-e63a-4fcb-8550-2134a3225bdc" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-b9989719-b15e-4fed-bca9-f9fbcec8c983-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6203857c-e63a-4fcb-8550-2134a3225bdc" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-quobyte-6677459d-2836-49c7-86cc-a26d1bb7f907" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-b9989719-b15e-4fed-bca9-f9fbcec8c983" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6677459d-2836-49c7-86cc-a26d1bb7f907" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Deleting offline snapshot 6677459d-2836-49c7-86cc-a26d1bb7f907 of volume 6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] snapshot_file for this snap is: volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88fbb7a-4376-4974-b9bd-76fd62fca99e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-b9989719-b15e-4fed-bca9-f9fbcec8c983" acquired by "delete_volume" :: waited 0.067s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efd31d4-bcd8-4d9d-b90c-fa340947bf89]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:01 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 Jul 17 05:44:01 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:01 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 1073741824" returned: 0 in 0.626s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:01 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 Jul 17 05:44:01 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:01 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 Jul 17 05:44:01 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:02 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6203857c-e63a-4fcb-8550-2134a3225bdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf2aa70-2124-4158-819c-0b24e0864003]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:02 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983" returned: 0 in 0.466s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:02 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45" returned: 0 in 0.283s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:02 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983 Jul 17 05:44:02 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31c98ab-446c-4d35-a1c7-c57e7e8606c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdcfd15-ca23-443a-9f3c-eed2dd51c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 (cc367d82-50c5-4a9c-845e-6e42c0b9bb45): created successfully Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdcfd15-ca23-443a-9f3c-eed2dd51c747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (e549ac68-966d-4787-9eb6-9333fa50f73e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1e4a8380-6f9a-47ac-82c5-1e5fccbdd585 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created volume successfully. Jul 17 05:44:02 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc Jul 17 05:44:02 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:02 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b9989719-b15e-4fed-bca9-f9fbcec8c983" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-b9989719-b15e-4fed-bca9-f9fbcec8c983" released by "delete_volume" :: held 0.800s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Created reservations ['0c41eb36-c423-49a3-b600-b8088548656a', '232a4420-c1dc-4fb1-86a4-3b1fde73b14e', '12b9535e-0b78-447a-ade2-19bea08ae165', 'eeca50cb-5057-4a42-b2b1-af1f561e6d58'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:02 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc" returned: 0 in 0.410s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:02 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 Jul 17 05:44:02 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-39b24e4d-64db-4266-aecb-ca652ae27f55-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:02 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:02 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-39b24e4d-64db-4266-aecb-ca652ae27f55-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-39b24e4d-64db-4266-aecb-ca652ae27f55" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-39b24e4d-64db-4266-aecb-ca652ae27f55" acquired by "delete_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0f15e7-31c8-4a8e-9988-c578c8cf538e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:02 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.380s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Deleted volume successfully. Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:02 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 Jul 17 05:44:02 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:02 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (7702851d-1ec6-4fe2-a42b-dcd11f4606be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4422b871-385e-4796-96a6-a4bece2c09c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907" returned: 0 in 0.573s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4422b871-385e-4796-96a6-a4bece2c09c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587576648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793a1a6b-40e4-4531-a747-881b34142f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:03Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907 Jul 17 05:44:03 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9e4192-32ab-430a-8eb1-de1b0bdeecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9e4192-32ab-430a-8eb1-de1b0bdeecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ea547d-208b-4534-8f78-f8cc6e96b5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ea547d-208b-4534-8f78-f8cc6e96b5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793a1a6b-40e4-4531-a747-881b34142f7d', 'volume_name': 'volume-793a1a6b-40e4-4531-a747-881b34142f7d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3613b3-702c-4175-bc12-005b5a77ef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3613b3-702c-4175-bc12-005b5a77ef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b61cbee-b082-4d0f-8722-5db64d5eb87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Volume 793a1a6b-40e4-4531-a747-881b34142f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793a1a6b-40e4-4531-a747-881b34142f7d', 'volume_size': 1} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587576648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793a1a6b-40e4-4531-a747-881b34142f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:03Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Creating volume 793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e951893e-6c69-4d81-a3a0-4521014f3335 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-b9989719-b15e-4fed-bca9-f9fbcec8c983-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:03 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d 1073741824 Jul 17 05:44:03 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:03 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55" returned: 0 in 0.533s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:03 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc.6677459d-2836-49c7-86cc-a26d1bb7f907" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:03 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55 Jul 17 05:44:03 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6677459d-2836-49c7-86cc-a26d1bb7f907" released by "_delete_snapshot" :: held 1.985s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6203857c-e63a-4fcb-8550-2134a3225bdc" released by "delete_snapshot" :: held 2.031s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (505f689a-b6d2-4f86-8061-55c7c5e1a86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc5377d-1092-45ce-a25b-5daaafaf9bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc5377d-1092-45ce-a25b-5daaafaf9bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1928670454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a7e37d-9b0a-4400-96cc-1f041d73d8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:03Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3e34b6-e57d-4c39-9037-b44ab3868c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3e34b6-e57d-4c39-9037-b44ab3868c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c22154d-e276-4d6a-81b6-5dbb7ca098cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c22154d-e276-4d6a-81b6-5dbb7ca098cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a7e37d-9b0a-4400-96cc-1f041d73d8ee', 'volume_name': 'volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc15080-1e18-4167-a8dd-84dfafa30d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc15080-1e18-4167-a8dd-84dfafa30d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2814c215-c9db-4d5a-93c3-6b593cbbb671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume e0a7e37d-9b0a-4400-96cc-1f041d73d8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee', 'volume_size': 1} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Created reservations ['e0c82e00-0ffb-41a0-bf61-5d6f45b54cf9', '9e1cc5b6-358e-4b78-a6b7-017191f729b2', '77ee4767-8573-4257-bf60-9b2a4ba7b006', 'db94e173-7b6e-4d3e-aec3-30c55a0cd852'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:03 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-39b24e4d-64db-4266-aecb-ca652ae27f55" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-39b24e4d-64db-4266-aecb-ca652ae27f55" released by "delete_volume" :: held 0.979s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Delete snapshot completed successfully. Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d1fe846-9c58-4689-b07d-a704c9aa8485 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-6677459d-2836-49c7-86cc-a26d1bb7f907-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Created reservations ['5adc6ff1-3c5b-460b-802a-2ef72ddd7d00', '4c89847a-322d-4b6c-93c5-ff2c9b6e99e5', '134d90f1-b18f-48fc-9551-e0256ab6c523', '9b5a9f9d-46f0-47d0-8b71-e3d2f73c2e69'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:03 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d 1073741824" returned: 0 in 0.761s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (9979fc84-3ff1-44dd-a863-90ecb23f545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea734f-3bc9-4d7a-8744-2c8ebb312f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:04 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d Jul 17 05:44:04 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea734f-3bc9-4d7a-8744-2c8ebb312f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221230495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97a6926-8d41-415b-8e1e-3f981085cb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:04Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5655b6f-c227-47f0-8ad5-658399a84474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5655b6f-c227-47f0-8ad5-658399a84474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012f07f3-9ff5-4311-8bfd-45cadbf55dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012f07f3-9ff5-4311-8bfd-45cadbf55dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97a6926-8d41-415b-8e1e-3f981085cb6a', 'volume_name': 'volume-b97a6926-8d41-415b-8e1e-3f981085cb6a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dd6372-8c70-4b9d-89b0-095d788ccd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05dd6372-8c70-4b9d-89b0-095d788ccd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f153e5ae-1000-4428-af81-f63fa90d5c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume b97a6926-8d41-415b-8e1e-3f981085cb6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97a6926-8d41-415b-8e1e-3f981085cb6a', 'volume_size': 1} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:04 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1928670454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a7e37d-9b0a-4400-96cc-1f041d73d8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:03Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Creating volume e0a7e37d-9b0a-4400-96cc-1f041d73d8ee {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:04 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b61cbee-b082-4d0f-8722-5db64d5eb87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793a1a6b-40e4-4531-a747-881b34142f7d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e9b978-056d-453b-98bd-9b8ed149592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee 1073741824 Jul 17 05:44:04 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Volume volume-793a1a6b-40e4-4531-a747-881b34142f7d (793a1a6b-40e4-4531-a747-881b34142f7d): created successfully Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e9b978-056d-453b-98bd-9b8ed149592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (7702851d-1ec6-4fe2-a42b-dcd11f4606be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.423s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Deleted volume successfully. Jul 17 05:44:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-22033af1-abef-4c98-8c78-2b3edcd6cc67 tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d61e4f6f-6d82-41b7-b0cc-7cf209000e29 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-39b24e4d-64db-4266-aecb-ca652ae27f55-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (d3107f3c-ceed-477f-b7e3-6512e2e949b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2d2ccc-f6df-4dcd-aa18-ad1e573ef430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2d2ccc-f6df-4dcd-aa18-ad1e573ef430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-203077894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd98db8-8580-4517-87de-d92801567724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:04Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322754c6-b634-4fc3-9bdf-ff2c73a1f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322754c6-b634-4fc3-9bdf-ff2c73a1f075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20532087-1e54-43fd-8a0f-14872c9f73ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20532087-1e54-43fd-8a0f-14872c9f73ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd98db8-8580-4517-87de-d92801567724', 'volume_name': 'volume-1dd98db8-8580-4517-87de-d92801567724', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6fe449-1fa7-4c71-ab90-69c0feb12d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6fe449-1fa7-4c71-ab90-69c0feb12d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299340bf-e1de-426a-832b-7579c82b2d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume 1dd98db8-8580-4517-87de-d92801567724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd98db8-8580-4517-87de-d92801567724', 'volume_size': 1} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-6203857c-e63a-4fcb-8550-2134a3225bdc-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-6203857c-e63a-4fcb-8550-2134a3225bdc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-quobyte-6203857c-e63a-4fcb-8550-2134a3225bdc" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6203857c-e63a-4fcb-8550-2134a3225bdc" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[344666a7-5d4f-431e-9261-95bda914730c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (c60ce38c-2e28-4e81-8379-b008ab0c2816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceee1c0f-8473-4d82-a3df-14939f28ea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-7e9bf4b2-324d-4524-a675-41387d2a4f41-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:04 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceee1c0f-8473-4d82-a3df-14939f28ea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762567506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f847ecc-6a44-4e9b-814f-cd6411847a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:05Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5af0c4-40dd-4214-b289-738f132d441e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5af0c4-40dd-4214-b289-738f132d441e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7298fae-60b7-4fc8-a6e6-72fb44af7984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7298fae-60b7-4fc8-a6e6-72fb44af7984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f847ecc-6a44-4e9b-814f-cd6411847a53', 'volume_name': 'volume-7f847ecc-6a44-4e9b-814f-cd6411847a53', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cd3ab8-0825-4117-ac68-8ff04d66cdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cd3ab8-0825-4117-ac68-8ff04d66cdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d896f827-156f-4852-8d84-4fc54bc33f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume 7f847ecc-6a44-4e9b-814f-cd6411847a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f847ecc-6a44-4e9b-814f-cd6411847a53', 'volume_size': 1} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee 1073741824" returned: 0 in 0.718s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:05 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-7e9bf4b2-324d-4524-a675-41387d2a4f41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:05 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-7e9bf4b2-324d-4524-a675-41387d2a4f41" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-7e9bf4b2-324d-4524-a675-41387d2a4f41" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Deleting offline snapshot 7e9bf4b2-324d-4524-a675-41387d2a4f41 of volume 71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] snapshot_file for this snap is: volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd11988-fdd9-4a17-8efd-f82fc89006dc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:05 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee Jul 17 05:44:05 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:05 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:05 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 Jul 17 05:44:05 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:05 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc Jul 17 05:44:05 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (3092a933-f622-437c-9545-ce10d76987a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83c0ab3-efff-49a7-b8f6-6401b1724a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83c0ab3-efff-49a7-b8f6-6401b1724a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618654515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b457d3-c0ec-46b1-b96a-40a66af63b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:05Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f947482d-010f-4924-bfca-74ddd9c01666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f947482d-010f-4924-bfca-74ddd9c01666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b642b4a-d440-43cb-9ffb-f89f8a9eefae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b642b4a-d440-43cb-9ffb-f89f8a9eefae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b457d3-c0ec-46b1-b96a-40a66af63b4f', 'volume_name': 'volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a9daa-5efe-48e4-9d56-5f98ff60d2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a9daa-5efe-48e4-9d56-5f98ff60d2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341144ed-cd77-4408-b382-a1c4efb52331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume 15b457d3-c0ec-46b1-b96a-40a66af63b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f', 'volume_size': 1} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221230495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97a6926-8d41-415b-8e1e-3f981085cb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:04Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Creating volume b97a6926-8d41-415b-8e1e-3f981085cb6a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:05 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2814c215-c9db-4d5a-93c3-6b593cbbb671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbcfea0-3cdd-4d42-9755-be0d8797cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:05 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a 1073741824 Jul 17 05:44:05 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee (e0a7e37d-9b0a-4400-96cc-1f041d73d8ee): created successfully Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbcfea0-3cdd-4d42-9755-be0d8797cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (505f689a-b6d2-4f86-8061-55c7c5e1a86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9bc00700-98b8-4360-ba65-5fee4bc2384b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created volume successfully. Jul 17 05:44:05 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-6203857c-e63a-4fcb-8550-2134a3225bdc" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:05 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41" returned: 0 in 0.612s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-6203857c-e63a-4fcb-8550-2134a3225bdc" released by "delete_volume" :: held 1.009s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1509bb39-8320-4b15-9bff-ddd17f2eeb79]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Created reservations ['69550508-5838-4efd-bc16-f7145b1ce9dc', '3fbf33c6-50ed-4aab-98cb-cf43c416fcb8', 'dffb4b64-b9a6-4b01-b921-1bd0e579d696', 'c6d40884-7948-416e-8763-0a271610069d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:05 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 Jul 17 05:44:05 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:05 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:05 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:06 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a 1073741824" returned: 0 in 0.534s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:06 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Deleted volume successfully. Jul 17 05:44:06 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:06 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 Jul 17 05:44:06 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-91cb70d7-69cf-4b91-ad35-db3962cb4f19 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-6203857c-e63a-4fcb-8550-2134a3225bdc-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:06 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a Jul 17 05:44:06 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:06 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.920s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-203077894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd98db8-8580-4517-87de-d92801567724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:04Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Creating volume 1dd98db8-8580-4517-87de-d92801567724 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:06 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:06 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 1073741824 Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f153e5ae-1000-4428-af81-f63fa90d5c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97a6926-8d41-415b-8e1e-3f981085cb6a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:06 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86f153d-3e50-44bb-a6b6-b90e6e7c8538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:06 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume volume-b97a6926-8d41-415b-8e1e-3f981085cb6a (b97a6926-8d41-415b-8e1e-3f981085cb6a): created successfully Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86f153d-3e50-44bb-a6b6-b90e6e7c8538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:06 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (9979fc84-3ff1-44dd-a863-90ecb23f545f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4eb2faba-6a92-47a7-a4f0-d07f6c3c201b tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created volume successfully. Jul 17 05:44:06 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41 Jul 17 05:44:06 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:06 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1.7e9bf4b2-324d-4524-a675-41387d2a4f41" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-7e9bf4b2-324d-4524-a675-41387d2a4f41" released by "_delete_snapshot" :: held 1.843s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-935bed72-b03b-472f-91a7-aa7113272f51-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" released by "delete_snapshot" :: held 1.885s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-935bed72-b03b-472f-91a7-aa7113272f51-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "cinder-quobyte-935bed72-b03b-472f-91a7-aa7113272f51" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:07 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 1073741824" returned: 0 in 0.507s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Created reservations ['855b6d7b-a75c-45b6-b9fe-05a1cb9aa84e', '740032a4-a21c-4448-b799-27b799dc08d6', '73c45e52-066b-4672-9610-f899c99a0a89', '9ec245c6-5869-46a7-ba2a-2a0215cdf369'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-935bed72-b03b-472f-91a7-aa7113272f51" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8678411-86b8-43ed-9dba-0fc2956bc5a9]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:07 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 Jul 17 05:44:07 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Delete snapshot completed successfully. Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12197f55-da66-4d80-81a6-80a570e1da87 tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-7e9bf4b2-324d-4524-a675-41387d2a4f41-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:07 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 Jul 17 05:44:07 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:07 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.376s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762567506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f847ecc-6a44-4e9b-814f-cd6411847a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:05Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Creating volume 7f847ecc-6a44-4e9b-814f-cd6411847a53 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:07 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299340bf-e1de-426a-832b-7579c82b2d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd98db8-8580-4517-87de-d92801567724', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792ddc89-685c-430b-a9e8-764dd84be8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:07 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 1073741824 Jul 17 05:44:07 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:07 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume volume-1dd98db8-8580-4517-87de-d92801567724 (1dd98db8-8580-4517-87de-d92801567724): created successfully Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792ddc89-685c-430b-a9e8-764dd84be8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (d3107f3c-ceed-477f-b7e3-6512e2e949b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-730643fd-f4d8-4339-a1f5-c3877396aeb4 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created volume successfully. Jul 17 05:44:07 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:07 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51 Jul 17 05:44:07 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:07 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-935bed72-b03b-472f-91a7-aa7113272f51" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-quobyte-935bed72-b03b-472f-91a7-aa7113272f51" released by "delete_volume" :: held 0.709s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Created reservations ['f68eac70-64a0-43bc-99c8-4b8ee580e4bf', '64ff586a-9d66-4db6-81e2-c47e43d83b80', 'aabac064-a6b2-4120-9d64-a706c08142b5', 'c4db8bf0-b14b-4007-90e1-38bc54f7a400'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:07 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 1073741824" returned: 0 in 0.459s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:07 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 Jul 17 05:44:07 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:07 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:07 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:08 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.550s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618654515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b457d3-c0ec-46b1-b96a-40a66af63b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bb2304ad864345b9f8c1ca7081a7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:05Z,use_quota=True,user_id='78e70149d9f147cba23186a09394a3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Creating volume 15b457d3-c0ec-46b1-b96a-40a66af63b4f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:08 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:08 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d896f827-156f-4852-8d84-4fc54bc33f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f847ecc-6a44-4e9b-814f-cd6411847a53', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:08 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f 1073741824 Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2aafb8d-9f02-4e2b-81ce-1307317acbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:08 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Deleted volume successfully. Jul 17 05:44:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 (7f847ecc-6a44-4e9b-814f-cd6411847a53): created successfully Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2aafb8d-9f02-4e2b-81ce-1307317acbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (c60ce38c-2e28-4e81-8379-b008ab0c2816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4e6f8b10-cda2-4206-8561-e16419c3b5cb tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created volume successfully. Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cdc91873-8a5b-4a37-87db-858cbfad1de2 tempest-VolumeDependencyTests-285925982 None] Lock "cinder-935bed72-b03b-472f-91a7-aa7113272f51-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "cinder-quobyte-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0daad-06bc-4d07-8233-5c117d0a13d3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:08 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 Jul 17 05:44:08 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:08 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f 1073741824" returned: 0 in 0.563s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:08 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f Jul 17 05:44:08 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:08 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" returned: 0 in 0.475s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:08 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1 Jul 17 05:44:08 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:09 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.409s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341144ed-cd77-4408-b382-a1c4efb52331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1495b7e1-828f-4105-909e-3af6afb751f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 of volume 793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:44:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Volume volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f (15b457d3-c0ec-46b1-b96a-40a66af63b4f): created successfully Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1495b7e1-828f-4105-909e-3af6afb751f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:09 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Flow 'volume_create_manager' (3092a933-f622-437c-9545-ce10d76987a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b38e1c-b655-407f-9843-62b212942001]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1711ed9b-d079-42dc-b007-4be522865ee7 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created volume successfully. Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-quobyte-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1" released by "delete_volume" :: held 0.846s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Created reservations ['c7ad612e-c0d1-41bd-ab09-02cdf8c08423', 'd3bfe68e-e70e-44c0-bd36-4a096817853a', '5e42387d-5252-45f2-90b1-abb1ee2f1aae', 'fd65cf7c-bbf9-455b-b484-e29c666c299e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:09 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d Jul 17 05:44:09 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:09 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:09 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:09 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d" returned: 0 in 0.465s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:09 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 1G Jul 17 05:44:09 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:09 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.329s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Deleted volume successfully. Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9a189b6c-8b22-435c-b61d-99976eb0095c tempest-CreateVolumesFromSnapshotTest-399724468 None] Lock "cinder-71bc1c40-0529-45bd-92a7-b04d0aaf9fd1-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-15b457d3-c0ec-46b1-b96a-40a66af63b4f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-15b457d3-c0ec-46b1-b96a-40a66af63b4f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-quobyte-15b457d3-c0ec-46b1-b96a-40a66af63b4f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-15b457d3-c0ec-46b1-b96a-40a66af63b4f" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4662a5-32b3-48b3-ad03-884d4a2d9b6f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:10 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f Jul 17 05:44:10 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:10 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 1G" returned: 0 in 0.668s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793a1a6b-40e4-4531-a747-881b34142f7d -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:10 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793a1a6b-40e4-4531-a747-881b34142f7d -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 Jul 17 05:44:10 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:10 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:10 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f Jul 17 05:44:10 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:10 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793a1a6b-40e4-4531-a747-881b34142f7d -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:10 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 is being set with open permissions: ugo+rw Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:10 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 Jul 17 05:44:10 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:10 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-15b457d3-c0ec-46b1-b96a-40a66af63b4f" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-15b457d3-c0ec-46b1-b96a-40a66af63b4f" released by "delete_volume" :: held 0.791s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created reservations ['5f10745b-706b-46ac-8c6b-f06686dc4214', '921a8f57-ce74-4757-9ecc-0eca9aec754f', 'a50ae410-06a9-45de-82fe-b87df5e2ef46', '52da20b5-873c-43ac-8cb6-71c195cd8486'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:11 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:11 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:11 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-7f847ecc-6a44-4e9b-814f-cd6411847a53-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:11 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.info Jul 17 05:44:11 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-7f847ecc-6a44-4e9b-814f-cd6411847a53-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-quobyte-7f847ecc-6a44-4e9b-814f-cd6411847a53" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-7f847ecc-6a44-4e9b-814f-cd6411847a53" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3039e4c1-be7d-4e25-acdf-f90776689494]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:11 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Deleted volume successfully. Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e0cb4b05-9500-47a3-bcdb-bd70a45e7298 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-15b457d3-c0ec-46b1-b96a-40a66af63b4f-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:11 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.info" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.info is being set with open permissions: ugo+rw Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:11 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.info Jul 17 05:44:11 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:11 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 Jul 17 05:44:11 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:11 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.info" returned: 0 in 0.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:11 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53" returned: 0 in 0.533s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fccc7f58-b117-4d91-ba03-5b7b10eba893 tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:44:11 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53 Jul 17 05:44:11 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Flow 'volume_create_manager' (415c9fa1-122c-4a84-9e71-58dc439021c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2980a0-1495-4622-acad-f047319f98a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2980a0-1495-4622-acad-f047319f98a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7391f599-0b8c-4fef-8727-79786b35032e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1ab4ea69274df59e96382bc78def4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:12Z,use_quota=True,user_id='2aecd3bc8cac4aa6bdb37d7bbe6b9a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fd583b-0a46-46e2-9557-ef12abc54338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fd583b-0a46-46e2-9557-ef12abc54338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2288adbb-e152-4523-a088-95f5ee470721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2288adbb-e152-4523-a088-95f5ee470721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7391f599-0b8c-4fef-8727-79786b35032e', 'volume_name': 'volume-7391f599-0b8c-4fef-8727-79786b35032e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb29c63-9022-47b3-9cad-2c757936d027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb29c63-9022-47b3-9cad-2c757936d027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a380624f-51c6-46b3-87fb-a588eca59681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Volume 7391f599-0b8c-4fef-8727-79786b35032e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7391f599-0b8c-4fef-8727-79786b35032e', 'volume_size': 1} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7391f599-0b8c-4fef-8727-79786b35032e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1ab4ea69274df59e96382bc78def4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:12Z,use_quota=True,user_id='2aecd3bc8cac4aa6bdb37d7bbe6b9a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Creating volume 7391f599-0b8c-4fef-8727-79786b35032e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:12 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:12 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e 1073741824 Jul 17 05:44:12 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:12 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7f847ecc-6a44-4e9b-814f-cd6411847a53" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-7f847ecc-6a44-4e9b-814f-cd6411847a53" released by "delete_volume" :: held 0.878s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created reservations ['8e5843bf-d2c6-4b27-bff8-821e4ea91276', '0ea83c55-a004-4b91-9121-be668bae8e33', '68dd7b63-af36-49b4-a625-dcd08735a4f7', '4bd9f441-9e8b-4e2c-822d-cd22d8aec818'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:12 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:12 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:12 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Deleted volume successfully. Jul 17 05:44:12 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e 1073741824" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-65aebf5a-23d8-4029-a082-29b1491e236e tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-7f847ecc-6a44-4e9b-814f-cd6411847a53-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:12 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e Jul 17 05:44:12 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-793a1a6b-40e4-4531-a747-881b34142f7d" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-793a1a6b-40e4-4531-a747-881b34142f7d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:12 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e" returned: 0 in 0.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 of volume 793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a380624f-51c6-46b3-87fb-a588eca59681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7391f599-0b8c-4fef-8727-79786b35032e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801f441d-fbd7-41c1-a649-93e1e663b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbdfd16-7d86-41ce-b4bb-33338e8e1146]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Volume volume-7391f599-0b8c-4fef-8727-79786b35032e (7391f599-0b8c-4fef-8727-79786b35032e): created successfully Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801f441d-fbd7-41c1-a649-93e1e663b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Flow 'volume_create_manager' (415c9fa1-122c-4a84-9e71-58dc439021c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-03880420-09ab-4323-a496-a9f81489d964 tempest-CinderUnicodeTest-1667268914 None] Created volume successfully. Jul 17 05:44:13 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 Jul 17 05:44:13 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:13 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" returned: 0 in 0.375s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793a1a6b-40e4-4531-a747-881b34142f7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-1dd98db8-8580-4517-87de-d92801567724-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14a610-6d79-48b5-a5c7-961e20ed1fc8]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-1dd98db8-8580-4517-87de-d92801567724-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-quobyte-1dd98db8-8580-4517-87de-d92801567724" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-1dd98db8-8580-4517-87de-d92801567724" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b04c04-1861-4a61-8129-327b5ff87ca1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:13 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d Jul 17 05:44:13 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:13 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 Jul 17 05:44:13 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:13 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:13 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 Jul 17 05:44:13 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:13 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:13 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724 Jul 17 05:44:13 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:14 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" returned: 0 in 0.381s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:14 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1dd98db8-8580-4517-87de-d92801567724" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:14 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98 Jul 17 05:44:14 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-1dd98db8-8580-4517-87de-d92801567724" released by "delete_volume" :: held 0.752s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created reservations ['237a540b-58ab-4852-8a46-9e8e929d5550', '736932e7-91aa-47f1-8cc8-648ddfee923d', '3137f787-d381-4201-a420-cc27f2175873', 'c355c15a-b1ed-4d51-ac98-61269fa9984e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:14 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:14 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:14 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d.cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" returned: 0 in 0.328s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98" released by "_delete_snapshot" :: held 1.655s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-793a1a6b-40e4-4531-a747-881b34142f7d" released by "delete_snapshot" :: held 1.688s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-b97a6926-8d41-415b-8e1e-3f981085cb6a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-b97a6926-8d41-415b-8e1e-3f981085cb6a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-quobyte-b97a6926-8d41-415b-8e1e-3f981085cb6a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-b97a6926-8d41-415b-8e1e-3f981085cb6a" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Created reservations ['02851fde-1bde-4fea-a685-700fe4ceb805', '1ae8e3ba-fc93-4031-8a7a-d3f982c85c88', '830b1f9d-33b9-4ec9-8f86-204900197adc', 'f6c6d058-2f8c-4486-a218-b1cbd52c962f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[908250fa-4b22-4cd8-af99-9e025124746d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:14 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Flow 'volume_create_manager' (d28445a2-2b09-4f90-9940-a550e7dcaf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9139e913-db3f-4fd5-a774-599891ec3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.456s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Deleted volume successfully. Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9139e913-db3f-4fd5-a774-599891ec3981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-436414487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85cec26-8e45-4f26-8549-ce99e4407d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1ab4ea69274df59e96382bc78def4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:15Z,use_quota=True,user_id='2aecd3bc8cac4aa6bdb37d7bbe6b9a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010c7d44-5500-4e8d-9393-d9f2ac62028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010c7d44-5500-4e8d-9393-d9f2ac62028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81948695-01cd-45ec-8d06-0fee2290e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81948695-01cd-45ec-8d06-0fee2290e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85cec26-8e45-4f26-8549-ce99e4407d32', 'volume_name': 'volume-b85cec26-8e45-4f26-8549-ce99e4407d32', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611268f1-c739-4bb1-9274-c1ded12e0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:14 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a Jul 17 05:44:14 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611268f1-c739-4bb1-9274-c1ded12e0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c493adcd-8fed-4a00-9c16-e12a85c3ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Volume b85cec26-8e45-4f26-8549-ce99e4407d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85cec26-8e45-4f26-8549-ce99e4407d32', 'volume_size': 1} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-436414487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85cec26-8e45-4f26-8549-ce99e4407d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1ab4ea69274df59e96382bc78def4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:15Z,use_quota=True,user_id='2aecd3bc8cac4aa6bdb37d7bbe6b9a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Creating volume b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:15 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:15 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 1073741824 Jul 17 05:44:15 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9b82eaa6-5915-4ba3-97a8-43877584c8f2 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-1dd98db8-8580-4517-87de-d92801567724-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-238744f9-d9df-47b6-8d2e-3774cfbf49d2 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-cc1d4b4d-3dcc-4cd5-aab8-5ad8e40bdf98-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-793a1a6b-40e4-4531-a747-881b34142f7d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-793a1a6b-40e4-4531-a747-881b34142f7d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-793a1a6b-40e4-4531-a747-881b34142f7d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-793a1a6b-40e4-4531-a747-881b34142f7d" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[805b79a5-45bf-4386-a815-3431121208fe]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:15 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:15 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a Jul 17 05:44:15 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:15 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d Jul 17 05:44:15 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:15 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 1073741824" returned: 0 in 0.666s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:15 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b97a6926-8d41-415b-8e1e-3f981085cb6a" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-b97a6926-8d41-415b-8e1e-3f981085cb6a" released by "delete_volume" :: held 0.916s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:15 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 Jul 17 05:44:15 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created reservations ['d3337db4-29d7-4bca-b5fb-68cc8abe0ca3', 'f1e039d1-0e7e-4f94-828e-8224c4287b89', '93cfaa10-ef05-478f-9b72-b4c695704a13', '50d97d66-73ef-45c0-8563-e3a9169d857a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:15 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d" returned: 0 in 0.625s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:15 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:15 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:15 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d Jul 17 05:44:15 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:16 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32" returned: 0 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c493adcd-8fed-4a00-9c16-e12a85c3ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85cec26-8e45-4f26-8549-ce99e4407d32', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbe46e8-b5f8-45ac-b47d-6f8c15d9c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Volume volume-b85cec26-8e45-4f26-8549-ce99e4407d32 (b85cec26-8e45-4f26-8549-ce99e4407d32): created successfully Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbe46e8-b5f8-45ac-b47d-6f8c15d9c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Flow 'volume_create_manager' (d28445a2-2b09-4f90-9940-a550e7dcaf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5c4041fb-8ee3-4af9-aa62-e04a4ff40468 tempest-CinderUnicodeTest-1667268914 None] Created volume successfully. Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:16 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Flow 'volume_create_manager' (4e0a8215-1f23-466e-8954-657d99116566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80e2dd8-836f-4386-8bd3-d9933b1f8864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Deleted volume successfully. Jul 17 05:44:16 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80e2dd8-836f-4386-8bd3-d9933b1f8864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ebfe7c-23b0-4335-9671-bdcfa11875b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb18f2225da4d5a98d63dfb9f9d9afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:16Z,use_quota=True,user_id='3c1bbe6a7fad4f87abce0d3c76c0dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d896023-bdfb-4420-be62-cb7f72975ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d896023-bdfb-4420-be62-cb7f72975ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d73dd00-d2d1-44da-85b6-b1c7d71417bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-793a1a6b-40e4-4531-a747-881b34142f7d" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-793a1a6b-40e4-4531-a747-881b34142f7d" released by "delete_volume" :: held 1.068s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d9b0403e-9a2f-4c18-9c16-f65b54661be5 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-b97a6926-8d41-415b-8e1e-3f981085cb6a-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Created reservations ['60826e6a-fae0-48d9-994b-a98f38dee518', 'f02be691-28e3-402f-b036-66dc54b07561', '7b5e02cc-2267-452b-a6bd-e4af46d8db6b', 'f1eaf8b2-c405-4583-8796-f175193c8943'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:16 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:16 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d73dd00-d2d1-44da-85b6-b1c7d71417bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45ebfe7c-23b0-4335-9671-bdcfa11875b2', 'volume_name': 'volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2', 'volume_size': 1, 'image_id': 'a9914d0a-f53d-4511-9501-2af2f5a657ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9914d0a-f53d-4511-9501-2af2f5a657ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6e44e129428ade58fe6cfa33799f9b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efb18f2225da4d5a98d63dfb9f9d9afe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c1ec7bd2b5cb612a05a0a9d0048124e6e726e94eda87529fc832d523a6f7ceab8c88a445d1ff6a8dfb4edeee94425449642c086a0c2ee68064ecdaa530da15ae', 'id': 'a9914d0a-f53d-4511-9501-2af2f5a657ab', 'created_at': datetime.datetime(2026, 7, 17, 3, 44, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 44, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9914d0a-f53d-4511-9501-2af2f5a657ab/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee45494-a2a9-4f38-b206-56afe2bb4890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee45494-a2a9-4f38-b206-56afe2bb4890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee08d7ea-6845-4609-98df-d235b6725685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Volume 45ebfe7c-23b0-4335-9671-bdcfa11875b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2', 'volume_size': 1, 'image_id': 'a9914d0a-f53d-4511-9501-2af2f5a657ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9914d0a-f53d-4511-9501-2af2f5a657ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6e44e129428ade58fe6cfa33799f9b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efb18f2225da4d5a98d63dfb9f9d9afe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c1ec7bd2b5cb612a05a0a9d0048124e6e726e94eda87529fc832d523a6f7ceab8c88a445d1ff6a8dfb4edeee94425449642c086a0c2ee68064ecdaa530da15ae', 'id': 'a9914d0a-f53d-4511-9501-2af2f5a657ab', 'created_at': datetime.datetime(2026, 7, 17, 3, 44, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 44, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9914d0a-f53d-4511-9501-2af2f5a657ab/file', 'properties': {}}, 'image_service': } Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Trying to clone 45ebfe7c-23b0-4335-9671-bdcfa11875b2 from image a9914d0a-f53d-4511-9501-2af2f5a657ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9914d0a-f53d-4511-9501-2af2f5a657ab', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 05:44:16 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Image download 0.00 MB at 0.00 MB/s Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd0a36-31f5-44a6-9f3c-3309a4bcd4ab]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:16 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8528b84b-7b23-45b2-af73-6ace945da9c7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-793a1a6b-40e4-4531-a747-881b34142f7d-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:16 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD Jul 17 05:44:16 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-quobyte-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aca5cc-99eb-49d2-b244-263ccf582e62]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:17 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:17 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee Jul 17 05:44:17 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:17 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD Jul 17 05:44:17 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Creating offline snapshot 0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 of volume b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4ced18-6eba-40eb-8d57-c7929489d7ce]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:17 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 Jul 17 05:44:17 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:17 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Temporary image a9914d0a-f53d-4511-9501-2af2f5a657ab is fetched for user 3c1bbe6a7fad4f87abce0d3c76c0dde5. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 05:44:17 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:17 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee Jul 17 05:44:17 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0bd157-ec83-49d1-afcd-72bb51e24682]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:17 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:17 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD Jul 17 05:44:17 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:17 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 1G Jul 17 05:44:17 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:17 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee" released by "delete_volume" :: held 0.781s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created reservations ['9dd922e8-1283-4f90-a122-caa1f0579b0d', '0856efaa-3043-4ed5-bfaf-55afee92577e', 'bd183fd2-b952-4bbf-ac19-257ba526054b', '059595df-ae26-4adb-9443-ad04c4d1ea05'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:17 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:18 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:18 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (6358cc24-338a-4364-8803-553a44b44a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926539e1-d8da-449e-92d5-c036b8df01a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:18 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD Jul 17 05:44:18 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926539e1-d8da-449e-92d5-c036b8df01a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187812824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4391ee1c-17b6-43aa-9311-20ad61ad4880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:18Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97f4de9-9a31-4184-825f-df0bcc634542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97f4de9-9a31-4184-825f-df0bcc634542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b37c0c7-cf57-44f5-9aad-3838d334629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b37c0c7-cf57-44f5-9aad-3838d334629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4391ee1c-17b6-43aa-9311-20ad61ad4880', 'volume_name': 'volume-4391ee1c-17b6-43aa-9311-20ad61ad4880', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629b3809-3eb6-446f-8a16-7dacab55c5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629b3809-3eb6-446f-8a16-7dacab55c5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66ef9f2-2209-40c0-987a-ce65640784d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Volume 4391ee1c-17b6-43aa-9311-20ad61ad4880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4391ee1c-17b6-43aa-9311-20ad61ad4880', 'volume_size': 1} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-cc367d82-50c5-4a9c-845e-6e42c0b9bb45-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-cc367d82-50c5-4a9c-845e-6e42c0b9bb45-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "cinder-quobyte-cc367d82-50c5-4a9c-845e-6e42c0b9bb45" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-cc367d82-50c5-4a9c-845e-6e42c0b9bb45" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:18 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 1G" returned: 0 in 0.630s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85cec26-8e45-4f26-8549-ce99e4407d32 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1660d515-4936-4ee1-9577-e0b89429993f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:18 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85cec26-8e45-4f26-8549-ce99e4407d32 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 Jul 17 05:44:18 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:18 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Deleted volume successfully. Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e012e349-fc40-4c25-aa26-dd20ff1a3720 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-e0a7e37d-9b0a-4400-96cc-1f041d73d8ee-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:18 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD" returned: 1 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:18 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 Jul 17 05:44:18 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:18 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85cec26-8e45-4f26-8549-ce99e4407d32 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:18 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 is being set with open permissions: ugo+rw Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:18 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 Jul 17 05:44:18 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:18 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:18 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45 Jul 17 05:44:18 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:18 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:18 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.info Jul 17 05:44:18 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:18 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-cc367d82-50c5-4a9c-845e-6e42c0b9bb45" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-quobyte-cc367d82-50c5-4a9c-845e-6e42c0b9bb45" released by "delete_volume" :: held 0.717s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Created reservations ['1a03c221-6f61-41fc-8e64-f2aac8669e45', 'acbada9e-3b01-480b-82bb-664a7dcb6b90', '36640e0e-aaa3-4be2-b891-cc5f9070afef', '71f05c67-4266-40ea-ba2b-243761521002'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:19 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:19 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:19 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.info" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:19 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.info is being set with open permissions: ugo+rw Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:19 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.info Jul 17 05:44:19 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:19 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Deleted volume successfully. Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5faa15f1-6c82-4243-bf41-4fe577925ac3 tempest-CreateVolumesFromSourceVolumeTest-1022567230 None] Lock "cinder-cc367d82-50c5-4a9c-845e-6e42c0b9bb45-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:19 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.info" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187812824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4391ee1c-17b6-43aa-9311-20ad61ad4880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:18Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Creating volume 4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:19 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 1073741824 Jul 17 05:44:19 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9fabfc42-de15-4000-b7cb-703c0ce36001 tempest-CinderUnicodeTest-1667268914 None] Create snapshot completed successfully Jul 17 05:44:19 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 1073741824" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:19 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 Jul 17 05:44:19 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:20 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ebfe7c-23b0-4335-9671-bdcfa11875b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb18f2225da4d5a98d63dfb9f9d9afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:16Z,use_quota=True,user_id='3c1bbe6a7fad4f87abce0d3c76c0dde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Creating volume 45ebfe7c-23b0-4335-9671-bdcfa11875b2 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66ef9f2-2209-40c0-987a-ce65640784d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4391ee1c-17b6-43aa-9311-20ad61ad4880', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:20 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 1073741824 Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcbb0f9-a930-4869-b85a-81c1d5cd570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:20 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Volume volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 (4391ee1c-17b6-43aa-9311-20ad61ad4880): created successfully Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcbb0f9-a930-4869-b85a-81c1d5cd570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (6358cc24-338a-4364-8803-553a44b44a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-031f3ef8-e41f-4bfd-a53b-b6f71023e552 tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "cinder-0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "cinder-quobyte-b85cec26-8e45-4f26-8549-ce99e4407d32" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-b85cec26-8e45-4f26-8549-ce99e4407d32" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "cinder-quobyte-0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Deleting offline snapshot 0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 of volume b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] snapshot_file for this snap is: volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d26df20-4f61-468a-a34b-b907e9f9af12]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:20 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 Jul 17 05:44:20 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:20 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 1073741824" returned: 0 in 0.580s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:20 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 Jul 17 05:44:20 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:21 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b85cec26-8e45-4f26-8549-ce99e4407d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9adaf-882c-465b-b675-89d49de5a9b9]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:21 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Attempting download of a9914d0a-f53d-4511-9501-2af2f5a657ab ((None, [{'url': 'file:///opt/stack/data/glance/images/a9914d0a-f53d-4511-9501-2af2f5a657ab', 'metadata': {}}])) to volume 45ebfe7c-23b0-4335-9671-bdcfa11875b2. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 05:44:21 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 Jul 17 05:44:21 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885321a-f9b8-43a1-b2bd-8f7628bcf7c9]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9914d0a-f53d-4511-9501-2af2f5a657ab_03up4y30 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:21 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9914d0a-f53d-4511-9501-2af2f5a657ab_03up4y30 Jul 17 05:44:21 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot 15bd8506-e306-4ad9-9a7c-8e78cda3751b of volume 4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3432ff2b-4f02-4d15-a802-34adc42973dd]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:21 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32" returned: 0 in 0.552s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:21 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 Jul 17 05:44:21 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:21 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 Jul 17 05:44:21 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:21 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9914d0a-f53d-4511-9501-2af2f5a657ab_03up4y30" returned: 0 in 0.521s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9914d0a-f53d-4511-9501-2af2f5a657ab_03up4y30 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:21 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9914d0a-f53d-4511-9501-2af2f5a657ab_03up4y30 Jul 17 05:44:21 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:21 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880" returned: 0 in 0.405s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:21 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b 1G Jul 17 05:44:21 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:22 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" returned: 0 in 0.417s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:22 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6 Jul 17 05:44:22 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:22 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9914d0a-f53d-4511-9501-2af2f5a657ab_03up4y30" returned: 1 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9914d0a-f53d-4511-9501-2af2f5a657ab_03up4y30' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae28ed6-3cd4-4564-a9a2-425c8f55cd35]: (4, 'raw') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:22 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD Jul 17 05:44:22 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:22 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32.0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6" released by "_delete_snapshot" :: held 1.863s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-b85cec26-8e45-4f26-8549-ce99e4407d32" released by "delete_snapshot" :: held 1.900s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:22 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b 1G" returned: 0 in 0.506s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:22 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b Jul 17 05:44:22 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Created reservations ['444d3647-3b66-4bb4-a88c-fe2ae8d0f6e6', 'b4d7779d-5f63-41cc-947b-548d0433ec7c', '568ee393-1f3a-4b72-96fb-e8187c3f273f', '1b91111b-bb65-43bd-961f-ac7042b70f13'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:22 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Delete snapshot completed successfully. Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-090b1901-5aac-4189-9c01-b2c608b7dc4a tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-0a4b7ab3-60a5-4c66-825f-1e4a26a17bd6-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "cinder-b85cec26-8e45-4f26-8549-ce99e4407d32-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-b85cec26-8e45-4f26-8549-ce99e4407d32-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:22 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD Jul 17 05:44:22 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "cinder-quobyte-b85cec26-8e45-4f26-8549-ce99e4407d32" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-b85cec26-8e45-4f26-8549-ce99e4407d32" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:22 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:22 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b is being set with open permissions: ugo+rw Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5f1f3c-03bf-4847-9f41-6b198cfbc42c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:22 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b Jul 17 05:44:22 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 Jul 17 05:44:23 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD" returned: 1 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] a9914d0a-f53d-4511-9501-2af2f5a657ab was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:23 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 Jul 17 05:44:23 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:23 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.info Jul 17 05:44:23 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:23 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32 Jul 17 05:44:23 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.info" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:23 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.info is being set with open permissions: ugo+rw Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:23 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.info Jul 17 05:44:23 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b85cec26-8e45-4f26-8549-ce99e4407d32" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-b85cec26-8e45-4f26-8549-ce99e4407d32" released by "delete_volume" :: held 0.842s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:23 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2" returned: 0 in 0.649s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9914d0a-f53d-4511-9501-2af2f5a657ab_7uubvc65devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:44:23 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Created reservations ['8b8033e8-aafa-4f69-90ca-6743557067fe', 'b1d7007c-c6bc-4496-80e6-4ff10ac33ef2', '03601cb7-d1aa-49e8-b816-73fd1c777fcb', '5efd8d8e-f3ba-4f4a-b479-b557bb4f003b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:23 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 1G Jul 17 05:44:23 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:23 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.info" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:23 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:23 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-33cb5e99-d049-4e4f-90f6-fb8ca7a99779 tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "cinder-7391f599-0b8c-4fef-8727-79786b35032e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-7391f599-0b8c-4fef-8727-79786b35032e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "cinder-quobyte-7391f599-0b8c-4fef-8727-79786b35032e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-7391f599-0b8c-4fef-8727-79786b35032e" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a30c96-8dfe-40fa-855b-e9495fe2f1c2]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:24 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 1G" returned: 0 in 0.474s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Downloaded image a9914d0a-f53d-4511-9501-2af2f5a657ab ((None, [{'url': 'file:///opt/stack/data/glance/images/a9914d0a-f53d-4511-9501-2af2f5a657ab', 'metadata': {}}])) to volume 45ebfe7c-23b0-4335-9671-bdcfa11875b2 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Temporary image a9914d0a-f53d-4511-9501-2af2f5a657ab for user 3c1bbe6a7fad4f87abce0d3c76c0dde5 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Marking volume 45ebfe7c-23b0-4335-9671-bdcfa11875b2 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 05:44:24 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e Jul 17 05:44:24 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Copying metadata from image a9914d0a-f53d-4511-9501-2af2f5a657ab to 45ebfe7c-23b0-4335-9671-bdcfa11875b2. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Creating volume glance metadata for volume 45ebfe7c-23b0-4335-9671-bdcfa11875b2 backed by image a9914d0a-f53d-4511-9501-2af2f5a657ab with: {'image_id': 'a9914d0a-f53d-4511-9501-2af2f5a657ab', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f6e44e129428ade58fe6cfa33799f9b1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 05:44:24 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Deleted volume successfully. Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee08d7ea-6845-4609-98df-d235b6725685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2', 'volume_size': 1, 'image_id': 'a9914d0a-f53d-4511-9501-2af2f5a657ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9914d0a-f53d-4511-9501-2af2f5a657ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6e44e129428ade58fe6cfa33799f9b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efb18f2225da4d5a98d63dfb9f9d9afe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c1ec7bd2b5cb612a05a0a9d0048124e6e726e94eda87529fc832d523a6f7ceab8c88a445d1ff6a8dfb4edeee94425449642c086a0c2ee68064ecdaa530da15ae', 'id': 'a9914d0a-f53d-4511-9501-2af2f5a657ab', 'created_at': datetime.datetime(2026, 7, 17, 3, 44, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 3, 44, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9914d0a-f53d-4511-9501-2af2f5a657ab/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f416ad22-95c4-4424-8f3c-85bd120c125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2601ab7-99c5-4b34-8fb7-9787f3ee721f tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-b85cec26-8e45-4f26-8549-ce99e4407d32-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Volume volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 (45ebfe7c-23b0-4335-9671-bdcfa11875b2): created successfully Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f416ad22-95c4-4424-8f3c-85bd120c125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Flow 'volume_create_manager' (4e0a8215-1f23-466e-8954-657d99116566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0d471634-7ee9-41e2-8057-9cf36aa19710 tempest-VolumeImageDependencyTests-1357411072 None] Created volume successfully. Jul 17 05:44:24 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e" returned: 0 in 0.437s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:24 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e Jul 17 05:44:24 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-15bd8506-e306-4ad9-9a7c-8e78cda3751b-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-15bd8506-e306-4ad9-9a7c-8e78cda3751b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-4391ee1c-17b6-43aa-9311-20ad61ad4880" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-4391ee1c-17b6-43aa-9311-20ad61ad4880" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-15bd8506-e306-4ad9-9a7c-8e78cda3751b" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-15bd8506-e306-4ad9-9a7c-8e78cda3751b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot 15bd8506-e306-4ad9-9a7c-8e78cda3751b of volume 4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b5d218-89bc-4739-b05e-945c7516cb86]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:24 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b Jul 17 05:44:24 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:24 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-7391f599-0b8c-4fef-8727-79786b35032e" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-quobyte-7391f599-0b8c-4fef-8727-79786b35032e" released by "delete_volume" :: held 0.807s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Acquiring lock "cinder-45ebfe7c-23b0-4335-9671-bdcfa11875b2-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Created reservations ['8b8335f5-2311-438e-b143-2f680821d3a1', '4714860d-989c-4dcb-a073-4f5d7db65a94', 'f3b27984-89ed-48f5-b6d1-f5a9f3f48fad', 'eb1e1185-daf3-4700-abe3-775413640b75'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Lock "cinder-45ebfe7c-23b0-4335-9671-bdcfa11875b2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Acquiring lock "cinder-quobyte-45ebfe7c-23b0-4335-9671-bdcfa11875b2" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Lock "cinder-quobyte-45ebfe7c-23b0-4335-9671-bdcfa11875b2" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea63a5e-5849-4a5e-8130-c59e5923f1ec]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:25 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:25 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:25 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b" returned: 0 in 0.521s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4391ee1c-17b6-43aa-9311-20ad61ad4880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:25 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 Jul 17 05:44:25 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222309b-7a95-47ec-a1de-b4b1ac50fed9]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:25 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 Jul 17 05:44:25 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:25 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Deleted volume successfully. Jul 17 05:44:25 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2" returned: 0 in 0.500s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a46a1aca-adec-4bca-b1d4-0a040047a0a9 tempest-CinderUnicodeTest-1667268914 None] Lock "cinder-7391f599-0b8c-4fef-8727-79786b35032e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:25 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2 Jul 17 05:44:25 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:25 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880" returned: 0 in 0.591s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:25 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b Jul 17 05:44:25 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:25 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-45ebfe7c-23b0-4335-9671-bdcfa11875b2" returned: 0 in 0.329s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Lock "cinder-quobyte-45ebfe7c-23b0-4335-9671-bdcfa11875b2" released by "delete_volume" :: held 0.891s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:25 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Created reservations ['ff7c8e13-812b-47e9-b8d2-13cde6f28bb2', 'fdc91ce3-93bc-4572-af9f-5c518621841a', '45706b06-1627-49f4-af2e-97929124fbc7', '7d444c12-4588-412e-9085-ccef9484879e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:26 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:26 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:26 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b" returned: 0 in 0.588s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:26 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b Jul 17 05:44:26 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:26 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.425s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Deleted volume successfully. Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ed218962-f757-4336-8fc6-40edcb90b7ec tempest-VolumeImageDependencyTests-1357411072 None] Lock "cinder-45ebfe7c-23b0-4335-9671-bdcfa11875b2-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:26 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880.15bd8506-e306-4ad9-9a7c-8e78cda3751b" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-15bd8506-e306-4ad9-9a7c-8e78cda3751b" released by "_delete_snapshot" :: held 2.284s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-4391ee1c-17b6-43aa-9311-20ad61ad4880" released by "delete_snapshot" :: held 2.306s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Created reservations ['a817a195-6e0f-4b2e-8ab7-0c4d48361baa', '946e9bad-115a-4fc8-87b5-5ee8ecb14c66', '4b16644c-81b1-4bf1-80bf-1c7c9d0b7fbf', '50f99496-281a-47aa-ab12-279ec2d6fe66'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:44:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5addb705-28bf-4cc8-aa54-64302d6de12a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-15bd8506-e306-4ad9-9a7c-8e78cda3751b-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-4391ee1c-17b6-43aa-9311-20ad61ad4880-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Lock "cinder-4391ee1c-17b6-43aa-9311-20ad61ad4880-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-4391ee1c-17b6-43aa-9311-20ad61ad4880" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-4391ee1c-17b6-43aa-9311-20ad61ad4880" acquired by "delete_volume" :: waited 0.052s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e4e82-ce0c-43e0-9561-203fd435c744]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:28 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 Jul 17 05:44:28 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:28 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880" returned: 0 in 0.395s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:28 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880 Jul 17 05:44:28 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:28 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-4391ee1c-17b6-43aa-9311-20ad61ad4880" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-4391ee1c-17b6-43aa-9311-20ad61ad4880" released by "delete_volume" :: held 0.801s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=224,cinder:UPDATE=322,cinder:INSERT=78,cinder:DELETE=30 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=287,cinder:SELECT=232,cinder:INSERT=86,cinder:DELETE=24 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:44:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Created reservations ['3b886b6b-99f2-4f83-a681-5ef8407f86d2', 'fe1b6ac6-af1a-4f4a-b8d8-ff2190d6f48f', '66f90fa8-3b80-41ba-ad02-d11b54ebf0ae', 'dc0675bb-3919-473d-ad7f-f80064d72fdb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:29 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:29 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:29 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdd26325-005f-4ac8-a47d-4a49f185f61c tempest-ProjectMemberTests-1123032030 None] Lock "cinder-4391ee1c-17b6-43aa-9311-20ad61ad4880-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (9927699e-29a3-4646-a80e-31133f4dd65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c1fe57-29f1-4f4c-be2c-a97756480904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c1fe57-29f1-4f4c-be2c-a97756480904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815716239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204431e4-d45f-4784-bdd6-0047f04c5413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:30Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60d2a1b-5dde-4796-a39b-f4347cc17b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60d2a1b-5dde-4796-a39b-f4347cc17b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6f73ee-d2ab-4f80-9bc5-dd8b619a27da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6f73ee-d2ab-4f80-9bc5-dd8b619a27da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204431e4-d45f-4784-bdd6-0047f04c5413', 'volume_name': 'volume-204431e4-d45f-4784-bdd6-0047f04c5413', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f9b182-4dd5-46f5-aba9-16c6d13391e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f9b182-4dd5-46f5-aba9-16c6d13391e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f3b9a2-a3fb-477f-8498-d3a223240482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Volume 204431e4-d45f-4784-bdd6-0047f04c5413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204431e4-d45f-4784-bdd6-0047f04c5413', 'volume_size': 1} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815716239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204431e4-d45f-4784-bdd6-0047f04c5413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:30Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Creating volume 204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:29 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:30 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 1073741824 Jul 17 05:44:30 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:30 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 1073741824" returned: 0 in 0.692s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:30 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 Jul 17 05:44:30 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:31 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413" returned: 0 in 0.343s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f3b9a2-a3fb-477f-8498-d3a223240482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204431e4-d45f-4784-bdd6-0047f04c5413', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0730362-dd1a-4a5f-871c-db9b005a041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Volume volume-204431e4-d45f-4784-bdd6-0047f04c5413 (204431e4-d45f-4784-bdd6-0047f04c5413): created successfully Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0730362-dd1a-4a5f-871c-db9b005a041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (9927699e-29a3-4646-a80e-31133f4dd65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dcad2abf-e6c7-4a98-be54-c189d3b78893 tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:44:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ba515784-7902-4175-b471-a23ebb2603c5 tempest-ProjectAdminTests-957543668 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 05:44:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot 13322822-48d2-4a35-a5d2-a47771f03cb4 of volume 204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:44:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1032dd33-c651-433a-8986-b2d8e72fb50f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:32 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 Jul 17 05:44:32 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:32 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413" returned: 0 in 0.511s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:32 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 1G Jul 17 05:44:32 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:33 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 1G" returned: 0 in 0.535s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204431e4-d45f-4784-bdd6-0047f04c5413 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:33 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204431e4-d45f-4784-bdd6-0047f04c5413 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 Jul 17 05:44:33 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:33 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204431e4-d45f-4784-bdd6-0047f04c5413 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4" returned: 0 in 0.336s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:33 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 is being set with open permissions: ugo+rw Jul 17 05:44:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:33 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 Jul 17 05:44:33 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:33 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:33 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.info Jul 17 05:44:33 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:34 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.info" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:34 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.info is being set with open permissions: ugo+rw Jul 17 05:44:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:34 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.info Jul 17 05:44:34 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:34 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.info" returned: 0 in 0.460s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e9b2b07f-b9cb-46bd-8cee-977123d3e083 tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-13322822-48d2-4a35-a5d2-a47771f03cb4-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-13322822-48d2-4a35-a5d2-a47771f03cb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-204431e4-d45f-4784-bdd6-0047f04c5413" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-204431e4-d45f-4784-bdd6-0047f04c5413" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-13322822-48d2-4a35-a5d2-a47771f03cb4" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-13322822-48d2-4a35-a5d2-a47771f03cb4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot 13322822-48d2-4a35-a5d2-a47771f03cb4 of volume 204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b72920a-caba-44ea-85fa-3f6e958e520f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:35 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 Jul 17 05:44:35 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:36 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4" returned: 0 in 0.663s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-204431e4-d45f-4784-bdd6-0047f04c5413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7065409-4c8c-42d6-88c1-fbeb67fc5d99]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:36 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 Jul 17 05:44:36 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:36 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413" returned: 0 in 0.567s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:36 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 Jul 17 05:44:36 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:37 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4" returned: 0 in 0.554s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:37 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4 Jul 17 05:44:37 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:37 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413.13322822-48d2-4a35-a5d2-a47771f03cb4" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-13322822-48d2-4a35-a5d2-a47771f03cb4" released by "_delete_snapshot" :: held 2.320s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-204431e4-d45f-4784-bdd6-0047f04c5413" released by "delete_snapshot" :: held 2.352s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:37 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Created reservations ['1bb1a077-ef7a-4f27-bd12-60c0a35d3d26', '053717f4-24a9-4712-a9e7-0aeb78e03c75', '94781e75-a6a5-492a-a67e-8c7ab61ecb5d', '33e7169c-28d6-482d-b48c-34b5e44b34e5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:44:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3441858e-14ce-45ee-8831-30e8290171a1 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-13322822-48d2-4a35-a5d2-a47771f03cb4-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-204431e4-d45f-4784-bdd6-0047f04c5413-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-204431e4-d45f-4784-bdd6-0047f04c5413-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-204431e4-d45f-4784-bdd6-0047f04c5413" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-204431e4-d45f-4784-bdd6-0047f04c5413" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec9cc95-8a3a-4932-a06f-8665858d1c39]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:38 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 Jul 17 05:44:38 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:39 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413" returned: 0 in 0.432s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:39 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413 Jul 17 05:44:39 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:39 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-204431e4-d45f-4784-bdd6-0047f04c5413" returned: 0 in 0.360s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-204431e4-d45f-4784-bdd6-0047f04c5413" released by "delete_volume" :: held 0.882s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Created reservations ['91ad382b-1bda-4573-84c7-98f4897a71f5', '055ddf22-78cd-42a2-a66e-5bb59f030c64', '34c2d324-6f0a-43f5-b7e9-9300db434f5f', '42db25e8-31dd-4bd6-b8b3-0e2d85a53737'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:39 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:39 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:40 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.445s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ea055042-79e0-4423-9e93-fac709c04af4 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-204431e4-d45f-4784-bdd6-0047f04c5413-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (a6ab5a2d-0f90-4159-b383-a4e9202dded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389d03a0-2a0c-4dca-b157-1a69d033d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389d03a0-2a0c-4dca-b157-1a69d033d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351539958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6f78c4-745b-44b4-ae05-e9b9aa1f935b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:41Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33c9e86-d3b4-45eb-9fe0-fff06ad43e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33c9e86-d3b4-45eb-9fe0-fff06ad43e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c9bfae-9114-4f33-b3d8-3bad5aa5b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c9bfae-9114-4f33-b3d8-3bad5aa5b93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6f78c4-745b-44b4-ae05-e9b9aa1f935b', 'volume_name': 'volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8337e8-de2f-47c5-a6ad-0e0bb1f5e5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8337e8-de2f-47c5-a6ad-0e0bb1f5e5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4b2974-97ed-4a47-9f19-481977d04b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Volume 8a6f78c4-745b-44b4-ae05-e9b9aa1f935b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b', 'volume_size': 1} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351539958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6f78c4-745b-44b4-ae05-e9b9aa1f935b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:41Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Creating volume 8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:40 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:40 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b 1073741824 Jul 17 05:44:40 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:41 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b 1073741824" returned: 0 in 0.475s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:41 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b Jul 17 05:44:41 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:41 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4b2974-97ed-4a47-9f19-481977d04b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d15e1a7-d2f7-403b-9a62-1ba9133dc10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Volume volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b (8a6f78c4-745b-44b4-ae05-e9b9aa1f935b): created successfully Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d15e1a7-d2f7-403b-9a62-1ba9133dc10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (a6ab5a2d-0f90-4159-b383-a4e9202dded2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f48a5f50-5180-4e90-b95e-1ecf6048d8bc tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:44:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot 919b57f8-fa71-4d97-a65c-0073e8076030 of volume 8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:44:43 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2d2629-ae4d-4f44-8ccf-838d722b1d24]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:43 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b Jul 17 05:44:43 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:43 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" returned: 0 in 0.419s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:43 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 1G Jul 17 05:44:43 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:44 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 1G" returned: 0 in 0.556s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:44 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 Jul 17 05:44:44 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:44 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:44 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 is being set with open permissions: ugo+rw Jul 17 05:44:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:44 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 Jul 17 05:44:44 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:45 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:45 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.info Jul 17 05:44:45 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:45 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.info" returned: 0 in 0.289s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:45 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.info is being set with open permissions: ugo+rw Jul 17 05:44:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:45 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.info Jul 17 05:44:45 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:45 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.info" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b9388ac6-4171-41f4-87d1-b9a415b69bad tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-919b57f8-fa71-4d97-a65c-0073e8076030-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-919b57f8-fa71-4d97-a65c-0073e8076030-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-919b57f8-fa71-4d97-a65c-0073e8076030" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-919b57f8-fa71-4d97-a65c-0073e8076030" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot 919b57f8-fa71-4d97-a65c-0073e8076030 of volume 8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b3b82e-9173-4959-9077-2eee3a52e49f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:46 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 Jul 17 05:44:46 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:46 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030" returned: 0 in 0.460s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6db61c-3956-4485-83d0-68a57669fae3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:47 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b Jul 17 05:44:47 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:47 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" returned: 0 in 0.629s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:47 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 Jul 17 05:44:47 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:48 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030" returned: 0 in 0.412s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:48 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030 Jul 17 05:44:48 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:48 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b.919b57f8-fa71-4d97-a65c-0073e8076030" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-919b57f8-fa71-4d97-a65c-0073e8076030" released by "_delete_snapshot" :: held 1.984s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" released by "delete_snapshot" :: held 2.021s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Created reservations ['537cbdca-caaf-4a55-a615-4e074d36e761', 'c1f0ea65-1dd7-4cde-9802-81e467665ab5', '550d4390-cecc-4caa-8226-59e7365f5253', '94353246-fbb1-4d1b-bafa-4386ed4ecb7e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:44:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7f09a95-e52d-45c1-aecc-96b9412bf256 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-919b57f8-fa71-4d97-a65c-0073e8076030-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Lock "cinder-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb39480-a621-44d3-ac44-e31f7be0b87f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:50 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b Jul 17 05:44:50 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:50 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" returned: 0 in 0.498s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:50 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b Jul 17 05:44:50 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:50 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b" released by "delete_volume" :: held 0.965s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Created reservations ['a12ba664-22b6-4340-80b7-d8ff7c170f64', '7f6bff8e-ea31-476a-be05-b794d88aa875', 'a3f5ceaf-8b0a-40f7-8839-479298cdb10e', '4a696e94-a32b-4bcb-a2a8-dea2e71c4c58'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:51 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:51 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:51 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.315s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:44:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-292c9bb4-d80d-450c-85a6-17a8cc20d74e tempest-ProjectMemberTests-1123032030 None] Lock "cinder-8a6f78c4-745b-44b4-ae05-e9b9aa1f935b-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Flow 'volume_create_manager' (19b0dbd6-9d9b-49e9-ac64-e42de158d6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d818d4-bd88-4398-bdd4-a038c6f6782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d818d4-bd88-4398-bdd4-a038c6f6782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737382977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f5f557-b21f-48b2-981d-d9d3c0a7857a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d642456a20aa400697e7a256780b70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:52Z,use_quota=True,user_id='1914fdc66a1d4b76b3a66561f3ba6848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588d3e86-545a-42db-8cef-ee8b1461e7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588d3e86-545a-42db-8cef-ee8b1461e7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aed05a8-bfa5-4e73-9cbd-c7d9c3053f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aed05a8-bfa5-4e73-9cbd-c7d9c3053f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f5f557-b21f-48b2-981d-d9d3c0a7857a', 'volume_name': 'volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa22df1-7706-4d4b-a25a-3a4fde2f05fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa22df1-7706-4d4b-a25a-3a4fde2f05fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd460343-8fe9-47fa-b75e-a3f2ae051dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Volume 12f5f557-b21f-48b2-981d-d9d3c0a7857a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a', 'volume_size': 1} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737382977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f5f557-b21f-48b2-981d-d9d3c0a7857a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d642456a20aa400697e7a256780b70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:52Z,use_quota=True,user_id='1914fdc66a1d4b76b3a66561f3ba6848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Creating volume 12f5f557-b21f-48b2-981d-d9d3c0a7857a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:52 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a 1073741824 Jul 17 05:44:52 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (1906a952-1ac5-4edf-bc81-06ecfb0f228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5239d1b5-0e5b-42dd-8b3c-9e2d47a56cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5239d1b5-0e5b-42dd-8b3c-9e2d47a56cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656135850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31c212e-6309-442f-9ce4-ff0d92af2705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:53Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bd9224-ee29-4ced-b1be-dad2631503c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bd9224-ee29-4ced-b1be-dad2631503c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5623fca7-dd7c-485c-bce7-ce3afecd2dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5623fca7-dd7c-485c-bce7-ce3afecd2dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31c212e-6309-442f-9ce4-ff0d92af2705', 'volume_name': 'volume-b31c212e-6309-442f-9ce4-ff0d92af2705', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43da60b4-8c24-42de-ae92-6f129fc6fd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43da60b4-8c24-42de-ae92-6f129fc6fd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f8628e-39f7-4d7e-96e1-f75bdb774501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Volume b31c212e-6309-442f-9ce4-ff0d92af2705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31c212e-6309-442f-9ce4-ff0d92af2705', 'volume_size': 1} Jul 17 05:44:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:53 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a 1073741824" returned: 0 in 0.583s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:53 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a Jul 17 05:44:53 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:53 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656135850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31c212e-6309-442f-9ce4-ff0d92af2705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:53Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Creating volume b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:53 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:53 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 1073741824 Jul 17 05:44:53 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd460343-8fe9-47fa-b75e-a3f2ae051dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a074af-515b-4942-b834-6ef7bc11f31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Volume volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a (12f5f557-b21f-48b2-981d-d9d3c0a7857a): created successfully Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a074af-515b-4942-b834-6ef7bc11f31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Flow 'volume_create_manager' (19b0dbd6-9d9b-49e9-ac64-e42de158d6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4963ef5d-be1f-4cdf-86b4-61f71f5d3719 tempest-ProjectReaderTests-992058209 None] Created volume successfully. Jul 17 05:44:54 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 1073741824" returned: 0 in 0.682s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:54 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 Jul 17 05:44:54 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:54 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f8628e-39f7-4d7e-96e1-f75bdb774501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31c212e-6309-442f-9ce4-ff0d92af2705', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e880b2e-fd5a-4465-9ff8-c6808407217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Volume volume-b31c212e-6309-442f-9ce4-ff0d92af2705 (b31c212e-6309-442f-9ce4-ff0d92af2705): created successfully Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e880b2e-fd5a-4465-9ff8-c6808407217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (1906a952-1ac5-4edf-bc81-06ecfb0f228a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-66abb011-5878-4821-a6b9-bef09e1ceb1d tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Acquiring lock "cinder-12f5f557-b21f-48b2-981d-d9d3c0a7857a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Lock "cinder-12f5f557-b21f-48b2-981d-d9d3c0a7857a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Acquiring lock "cinder-quobyte-12f5f557-b21f-48b2-981d-d9d3c0a7857a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Lock "cinder-quobyte-12f5f557-b21f-48b2-981d-d9d3c0a7857a" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9087b9-e829-4aa9-a7a8-540a935f1288]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:55 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a Jul 17 05:44:55 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Flow 'volume_create_manager' (afab5fea-5c53-4aec-86fa-b7695baeb1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da9a763-0734-4254-a060-14f3d762773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da9a763-0734-4254-a060-14f3d762773e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-349364563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13af6d99-e7e5-4bb4-bfc1-f4f0c3677558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33619a986d454ea3af17dbee12d2aa91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:56Z,use_quota=True,user_id='1f3d798f558246bea7a83c28192c0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40642157-4dd2-49bc-b0f4-24c41038a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:55 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40642157-4dd2-49bc-b0f4-24c41038a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068061fb-0cd7-4fc3-ade4-476054f21d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068061fb-0cd7-4fc3-ade4-476054f21d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13af6d99-e7e5-4bb4-bfc1-f4f0c3677558', 'volume_name': 'volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e26877-2b86-445f-a55a-b45b9e0d4831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e26877-2b86-445f-a55a-b45b9e0d4831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0e9257-a876-4e39-b348-2a3091af322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Volume 13af6d99-e7e5-4bb4-bfc1-f4f0c3677558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558', 'volume_size': 1} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-349364563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13af6d99-e7e5-4bb4-bfc1-f4f0c3677558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33619a986d454ea3af17dbee12d2aa91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:56Z,use_quota=True,user_id='1f3d798f558246bea7a83c28192c0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Creating volume 13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:55 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a" returned: 0 in 0.468s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:55 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 1073741824 Jul 17 05:44:55 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:55 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a Jul 17 05:44:55 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:56 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-12f5f557-b21f-48b2-981d-d9d3c0a7857a" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Lock "cinder-quobyte-12f5f557-b21f-48b2-981d-d9d3c0a7857a" released by "delete_volume" :: held 0.894s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Created reservations ['2c549969-32a0-4b4f-8368-871e321ce76e', '62bcdb21-ba4c-45f9-af1f-ac2afec78d4c', '9a593ca2-0b94-4351-be6a-b8148b87aa76', 'a22019bf-55c3-4757-b268-e62951379134'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:56 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 1073741824" returned: 0 in 0.575s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:56 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:56 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:56 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 Jul 17 05:44:56 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:56 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:44:56 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:56 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Deleted volume successfully. Jul 17 05:44:56 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c779596-9810-49e6-84f4-cebd501e5ec2 tempest-ProjectReaderTests-992058209 None] Lock "cinder-12f5f557-b21f-48b2-981d-d9d3c0a7857a-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.568s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot d56d0686-99e0-4634-b5af-9f83f21fdc84 of volume b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0e9257-a876-4e39-b348-2a3091af322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d260f87-b681-4f05-9e28-33ba612f5ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ad1640-9f1a-4dc0-bc3b-25ab5a86bf21]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Volume volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 (13af6d99-e7e5-4bb4-bfc1-f4f0c3677558): created successfully Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d260f87-b681-4f05-9e28-33ba612f5ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Flow 'volume_create_manager' (afab5fea-5c53-4aec-86fa-b7695baeb1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-772e8e04-de12-485d-8813-3907eb3d2859 tempest-SnapshotDependencyTests-957433347 None] Created volume successfully. Jul 17 05:44:56 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:44:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:44:56 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 Jul 17 05:44:56 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Flow 'volume_create_manager' (1f981735-cfda-4d79-bb4a-dab7b4aa840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f3d350-3e64-47a1-a237-bba88a0ba508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f3d350-3e64-47a1-a237-bba88a0ba508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454610259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd6688d-caca-4b6f-b4a7-52bf3e26760f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d642456a20aa400697e7a256780b70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:57Z,use_quota=True,user_id='1914fdc66a1d4b76b3a66561f3ba6848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14906e8d-c8b0-4a45-b632-35637483d84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14906e8d-c8b0-4a45-b632-35637483d84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cbb2ef-3737-4feb-bf57-a31099a3fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cbb2ef-3737-4feb-bf57-a31099a3fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd6688d-caca-4b6f-b4a7-52bf3e26760f', 'volume_name': 'volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c44328-813b-4ed5-9ceb-8ec35bfc7533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c44328-813b-4ed5-9ceb-8ec35bfc7533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:57 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b0badc-e4cb-468e-af7b-f2366dedcd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Volume bcd6688d-caca-4b6f-b4a7-52bf3e26760f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f', 'volume_size': 1} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:57 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 1G Jul 17 05:44:57 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:57 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 1G" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31c212e-6309-442f-9ce4-ff0d92af2705 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:57 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31c212e-6309-442f-9ce4-ff0d92af2705 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 Jul 17 05:44:57 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:57 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31c212e-6309-442f-9ce4-ff0d92af2705 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:57 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 is being set with open permissions: ugo+rw Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:57 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 Jul 17 05:44:57 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:58 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:58 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.info Jul 17 05:44:58 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:58 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.info" returned: 0 in 0.240s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:58 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.info is being set with open permissions: ugo+rw Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:58 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.info Jul 17 05:44:58 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:58 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.info" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.503s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454610259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd6688d-caca-4b6f-b4a7-52bf3e26760f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d642456a20aa400697e7a256780b70db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:44:57Z,use_quota=True,user_id='1914fdc66a1d4b76b3a66561f3ba6848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Creating volume bcd6688d-caca-4b6f-b4a7-52bf3e26760f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:44:58 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:44:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:58 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f 1073741824 Jul 17 05:44:58 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d187a05f-1b98-4a80-9a73-c2b16a9de81a tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:44:59 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f 1073741824" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:59 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f Jul 17 05:44:59 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-d56d0686-99e0-4634-b5af-9f83f21fdc84-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-d56d0686-99e0-4634-b5af-9f83f21fdc84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-b31c212e-6309-442f-9ce4-ff0d92af2705" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-b31c212e-6309-442f-9ce4-ff0d92af2705" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-d56d0686-99e0-4634-b5af-9f83f21fdc84" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-d56d0686-99e0-4634-b5af-9f83f21fdc84" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot d56d0686-99e0-4634-b5af-9f83f21fdc84 of volume b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66ec832-460b-4581-87d4-b260c165c0f0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:59 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.488s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Creating offline snapshot 8186a45d-7279-4b49-8467-8f1e8b00c0b2 of volume 13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b0badc-e4cb-468e-af7b-f2366dedcd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30055f90-c7d7-4427-8b04-4144cc5826df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc68e97e-25d1-4812-a49a-110ae8362f88]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:59 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 Jul 17 05:44:59 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Volume volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f (bcd6688d-caca-4b6f-b4a7-52bf3e26760f): created successfully Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30055f90-c7d7-4427-8b04-4144cc5826df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Flow 'volume_create_manager' (1f981735-cfda-4d79-bb4a-dab7b4aa840c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:44:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2f77a40b-70af-4c39-a24c-657c9a322e4c tempest-ProjectReaderTests-992058209 None] Created volume successfully. Jul 17 05:44:59 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 Jul 17 05:44:59 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:59 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84" returned: 0 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b31c212e-6309-442f-9ce4-ff0d92af2705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597ebf8-0b5d-4c6c-aacb-44b40584abf6]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:59 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:44:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:44:59 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 Jul 17 05:44:59 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:44:59 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 1G Jul 17 05:44:59 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:00 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 Jul 17 05:45:00 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Acquiring lock "cinder-bcd6688d-caca-4b6f-b4a7-52bf3e26760f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Lock "cinder-bcd6688d-caca-4b6f-b4a7-52bf3e26760f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Acquiring lock "cinder-quobyte-bcd6688d-caca-4b6f-b4a7-52bf3e26760f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Lock "cinder-quobyte-bcd6688d-caca-4b6f-b4a7-52bf3e26760f" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:00 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 1G" returned: 0 in 0.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa2cb0b-21c4-4d7b-893f-915713dc68ae]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:00 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 Jul 17 05:45:00 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f Jul 17 05:45:00 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:00 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84 Jul 17 05:45:00 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 is being set with open permissions: ugo+rw Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:00 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 Jul 17 05:45:00 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:00 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f Jul 17 05:45:00 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705.d56d0686-99e0-4634-b5af-9f83f21fdc84" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-d56d0686-99e0-4634-b5af-9f83f21fdc84" released by "_delete_snapshot" :: held 1.517s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-b31c212e-6309-442f-9ce4-ff0d92af2705" released by "delete_snapshot" :: held 1.549s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:00 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Created reservations ['29b156c5-0ff0-4ed6-8670-e122fcec0c17', '37c8eed4-42c7-4937-983c-224e5a093572', '91c942a8-2473-471e-a9ec-03fdce750d44', 'e1093ef5-0596-491e-ae4e-fd85248441ca'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:00 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.info Jul 17 05:45:00 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:00 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-bcd6688d-caca-4b6f-b4a7-52bf3e26760f" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Lock "cinder-quobyte-bcd6688d-caca-4b6f-b4a7-52bf3e26760f" released by "delete_volume" :: held 0.739s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0a1f8a2d-82b9-4aca-b2a0-8f562758056a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-d56d0686-99e0-4634-b5af-9f83f21fdc84-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Created reservations ['c1ee79c5-2f8b-494c-8a81-c8191c5ebaf3', 'ec628bf5-70b1-4540-ba0b-6db9116017c0', 'ffe26930-4d0b-450d-9016-69ddebf7cdd3', 'd26a2dea-c015-4edc-b7f0-32fe8b15cb43'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:01 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:01 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:01 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.info" returned: 0 in 0.270s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:01 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.info is being set with open permissions: ugo+rw Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:01 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.info Jul 17 05:45:01 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:01 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Deleted volume successfully. Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7e4c7751-8639-4c2b-aed6-d84acf7e311d tempest-ProjectReaderTests-992058209 None] Lock "cinder-bcd6688d-caca-4b6f-b4a7-52bf3e26760f-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:01 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-b31c212e-6309-442f-9ce4-ff0d92af2705-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.info" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-b31c212e-6309-442f-9ce4-ff0d92af2705-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4e0410df-02ce-48c2-9816-a7fbcbea463b tempest-SnapshotDependencyTests-957433347 None] Create snapshot completed successfully Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-b31c212e-6309-442f-9ce4-ff0d92af2705" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-b31c212e-6309-442f-9ce4-ff0d92af2705" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e4878-b524-49d5-a578-e588e66ddf3e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:01 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 Jul 17 05:45:01 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:02 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705" returned: 0 in 0.381s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:02 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705 Jul 17 05:45:02 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:02 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-b31c212e-6309-442f-9ce4-ff0d92af2705" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-b31c212e-6309-442f-9ce4-ff0d92af2705" released by "delete_volume" :: held 0.786s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Created reservations ['55c5abc3-2e49-4cd0-93e7-3c0535a8733d', '47acbae4-79cd-4cd3-b9ac-84dc7ec6d9b1', '1a6644dc-868e-478d-ab37-dc3ac5175e4d', '6f5da2d5-d71a-41b3-90bb-cd406fc482a7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:02 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:02 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Flow 'volume_create_manager' (37635864-fd73-4c1b-b622-5e3de20df2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd594632-15d5-4076-8ec7-e42c018fc07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:02 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd594632-15d5-4076-8ec7-e42c018fc07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813df09e-47d7-405e-a765-7612801f8aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33619a986d454ea3af17dbee12d2aa91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8186a45d-7279-4b49-8467-8f1e8b00c0b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:03Z,use_quota=True,user_id='1f3d798f558246bea7a83c28192c0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbfa111-f5e3-40f6-9c98-047964bb3736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbfa111-f5e3-40f6-9c98-047964bb3736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82be5024-87ad-4bc8-910c-2b76aa6e14ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82be5024-87ad-4bc8-910c-2b76aa6e14ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '813df09e-47d7-405e-a765-7612801f8aca', 'volume_name': 'volume-813df09e-47d7-405e-a765-7612801f8aca', 'volume_size': 1, 'snapshot_id': '8186a45d-7279-4b49-8467-8f1e8b00c0b2'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5878197-f99f-4b8d-8801-6b478513cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5878197-f99f-4b8d-8801-6b478513cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea8aaa-fe43-44f0-87d0-acba9f36ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Volume 813df09e-47d7-405e-a765-7612801f8aca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-813df09e-47d7-405e-a765-7612801f8aca', 'volume_size': 1, 'snapshot_id': '8186a45d-7279-4b49-8467-8f1e8b00c0b2'} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-quobyte-8186a45d-7279-4b49-8467-8f1e8b00c0b2-813df09e-47d7-405e-a765-7612801f8aca" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-8186a45d-7279-4b49-8467-8f1e8b00c0b2-813df09e-47d7-405e-a765-7612801f8aca" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Creating volume 813df09e-47d7-405e-a765-7612801f8aca from snapshot 8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-quobyte-813df09e-47d7-405e-a765-7612801f8aca" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a81e594-39f0-44b9-ba48-f2285d598ab7 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-b31c212e-6309-442f-9ce4-ff0d92af2705-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-813df09e-47d7-405e-a765-7612801f8aca" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] snapshot: 8186a45d-7279-4b49-8467-8f1e8b00c0b2, volume: 813df09e-47d7-405e-a765-7612801f8aca, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b09d0-2789-4a4a-aa0b-26c66f424bbc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:03 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 Jul 17 05:45:03 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:03 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e72789-329c-43a0-b241-f75b74039f24]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:03 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 Jul 17 05:45:03 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:03 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Path /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 05:45:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:03 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca Jul 17 05:45:03 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (a8c14f2e-9716-4603-99be-2c14aa2492d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9afe70f-62ed-4ecb-89f8-c5af21208bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9afe70f-62ed-4ecb-89f8-c5af21208bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983560286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:04Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06250da-0176-481e-b00f-923d982d573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06250da-0176-481e-b00f-923d982d573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59051e9b-ad8c-46f6-afa5-c756bed6c0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59051e9b-ad8c-46f6-afa5-c756bed6c0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1', 'volume_name': 'volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf60da8-ce17-4539-a763-f5c3fd5f77fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf60da8-ce17-4539-a763-f5c3fd5f77fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e72252b-03f0-4497-ba05-89a1e7952b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Volume 8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1', 'volume_size': 1} Jul 17 05:45:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:07 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca" returned: 0 in 4.072s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5388e161-6571-4897-8142-49915f264342]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:08 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 Jul 17 05:45:08 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:08 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" returned: 0 in 0.513s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 05:45:08 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Converted 1024.00 MB image at 251.43 MB/s Jul 17 05:45:08 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca is being set with open permissions: ugo+rw Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:08 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca Jul 17 05:45:08 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:08 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-813df09e-47d7-405e-a765-7612801f8aca" released by "_copy_volume_from_snapshot" :: held 5.634s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-8186a45d-7279-4b49-8467-8f1e8b00c0b2-813df09e-47d7-405e-a765-7612801f8aca" released by "_create_volume_from_snapshot" :: held 5.670s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.702s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.404s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983560286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:04Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Creating volume 8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:08 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:08 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 1073741824 Jul 17 05:45:08 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea8aaa-fe43-44f0-87d0-acba9f36ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813df09e-47d7-405e-a765-7612801f8aca', 'volume_size': 1, 'snapshot_id': '8186a45d-7279-4b49-8467-8f1e8b00c0b2'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687b9b32-9b83-4e7b-aa53-abade198a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Volume volume-813df09e-47d7-405e-a765-7612801f8aca (813df09e-47d7-405e-a765-7612801f8aca): created successfully Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687b9b32-9b83-4e7b-aa53-abade198a904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Flow 'volume_create_manager' (37635864-fd73-4c1b-b622-5e3de20df2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cae3e413-94f4-4c57-b5eb-fa0f8b94b3a2 tempest-SnapshotDependencyTests-957433347 None] Created volume successfully. Jul 17 05:45:09 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 1073741824" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:09 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 Jul 17 05:45:09 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:09 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e72252b-03f0-4497-ba05-89a1e7952b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2802053a-f49d-456a-bbb8-9c0b5e29c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Volume volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 (8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1): created successfully Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2802053a-f49d-456a-bbb8-9c0b5e29c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (a8c14f2e-9716-4603-99be-2c14aa2492d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-8186a45d-7279-4b49-8467-8f1e8b00c0b2-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c8a95933-abf0-4a43-8721-ffbfdabc2b98 tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-8186a45d-7279-4b49-8467-8f1e8b00c0b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-quobyte-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-quobyte-8186a45d-7279-4b49-8467-8f1e8b00c0b2" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-8186a45d-7279-4b49-8467-8f1e8b00c0b2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Deleting offline snapshot 8186a45d-7279-4b49-8467-8f1e8b00c0b2 of volume 13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] snapshot_file for this snap is: volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8f3b8-0546-4eb8-80ff-b6765bc1e057]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:09 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 Jul 17 05:45:09 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot 7e80aa5d-6852-40ff-bb58-dea6328d9f08 of volume 8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db9250e-596e-4b3f-90f2-24aa5a64640b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:09 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[16571823-58b8-4030-abdd-0f6e62bd9f1e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:10 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 Jul 17 05:45:10 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:10 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 Jul 17 05:45:10 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:10 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:10 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 1G Jul 17 05:45:10 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:10 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:10 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 Jul 17 05:45:10 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:10 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:10 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 1G" returned: 0 in 0.423s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:10 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2 Jul 17 05:45:10 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:10 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 Jul 17 05:45:10 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:10 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558.8186a45d-7279-4b49-8467-8f1e8b00c0b2" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-8186a45d-7279-4b49-8467-8f1e8b00c0b2" released by "_delete_snapshot" :: held 1.525s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:11 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 is being set with open permissions: ugo+rw Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" released by "delete_snapshot" :: held 1.555s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:11 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 Jul 17 05:45:11 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Created reservations ['642e4099-844a-405a-9547-1bea425cc919', 'c9aa4006-75bb-453b-ae6c-68689041e3c2', 'b6a2fab7-907f-4214-bedf-289aa3759dff', '89303185-276d-4972-982a-fcbe4b3cf73e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Delete snapshot completed successfully. Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ba8a32fb-2e46-44ed-aa5e-1de4212e1cd4 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-8186a45d-7279-4b49-8467-8f1e8b00c0b2-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:11 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:11 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.info Jul 17 05:45:11 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:11 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.info" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.info is being set with open permissions: ugo+rw Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:11 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.info Jul 17 05:45:11 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-quobyte-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adcabc7-f57f-4899-932e-5727a5633768]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:11 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.info" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:11 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 Jul 17 05:45:11 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-765038db-2035-4a6c-922b-1f567695185c tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-7e80aa5d-6852-40ff-bb58-dea6328d9f08-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-7e80aa5d-6852-40ff-bb58-dea6328d9f08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-7e80aa5d-6852-40ff-bb58-dea6328d9f08" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-7e80aa5d-6852-40ff-bb58-dea6328d9f08" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot 7e80aa5d-6852-40ff-bb58-dea6328d9f08 of volume 8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:45:12 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" returned: 0 in 0.379s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e448e2-351f-4b3f-8a87-3dc682fda989]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:12 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558 Jul 17 05:45:12 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:12 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 Jul 17 05:45:12 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:12 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558" released by "delete_volume" :: held 0.683s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Created reservations ['a1f9b46f-a84c-4f01-82d0-f0e096a86db7', 'd840023e-1753-4e10-a859-19983daca684', '8b4ee528-7f46-42d6-99e0-f905880839a4', '1e4f08de-bf74-4a5e-b3bb-4c15ae852df8'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:12 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:12 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:12 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4011b576-f8a7-4ca9-9627-503d04266097]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:12 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 Jul 17 05:45:12 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:12 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Deleted volume successfully. Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4ddbf9e2-b059-4cba-b025-4a3e9fb49d65 tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-13af6d99-e7e5-4bb4-bfc1-f4f0c3677558-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-813df09e-47d7-405e-a765-7612801f8aca-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-813df09e-47d7-405e-a765-7612801f8aca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "cinder-quobyte-813df09e-47d7-405e-a765-7612801f8aca" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-813df09e-47d7-405e-a765-7612801f8aca" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7968fd16-859d-483d-8291-056c9d7968ab]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:12 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:12 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 Jul 17 05:45:12 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:13 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca Jul 17 05:45:13 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:13 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:13 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:13 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca Jul 17 05:45:13 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:13 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08 Jul 17 05:45:13 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:13 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-813df09e-47d7-405e-a765-7612801f8aca" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-quobyte-813df09e-47d7-405e-a765-7612801f8aca" released by "delete_volume" :: held 0.664s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:13 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1.7e80aa5d-6852-40ff-bb58-dea6328d9f08" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-7e80aa5d-6852-40ff-bb58-dea6328d9f08" released by "_delete_snapshot" :: held 1.544s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" released by "delete_snapshot" :: held 1.571s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Created reservations ['1bed98ce-0ee6-47e1-8806-64a1e108043d', '221f4115-35fc-4987-bca4-1c1977475ab7', '9cfb16c8-efee-4149-bea5-5a29e0d80121', 'fd2c851a-7ca1-47ce-a480-5fa24ba09d8e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:13 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Created reservations ['0494e382-2397-4bf2-b239-9770df881c5b', '823ae03b-a660-4a6a-99fb-71e73cbd8cc2', '346c034e-427e-4354-80d6-c30411a865dd', '224a9e36-892b-4f79-b26c-8821f98d4fee'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:13 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e9ee77b4-82e5-4c3f-be7f-878f7f9dd73a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-7e80aa5d-6852-40ff-bb58-dea6328d9f08-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:13 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Deleted volume successfully. Jul 17 05:45:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-880f7134-7881-45e7-a007-ec99ebcba0fa tempest-SnapshotDependencyTests-957433347 None] Lock "cinder-813df09e-47d7-405e-a765-7612801f8aca-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d86b28-2f33-41b2-90e6-87ef793b0c53]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:14 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 Jul 17 05:45:14 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:14 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:14 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1 Jul 17 05:45:14 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:14 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1" released by "delete_volume" :: held 0.724s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Created reservations ['39ef2a92-3b00-42d0-92d3-66036a1ec7d1', 'd1bf330a-e482-4056-b425-f19a0f5aa576', '860156af-30bb-49b7-bf67-a1a6688c3592', '5184cc37-988d-4647-b7c0-2e6517e5bc5d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:15 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:15 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:15 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a91999cf-8d49-4dfb-a829-0331f9857695 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-8093dd72-6779-4a7d-a9b0-53ae3ca9d1c1-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (5bc485b3-840d-43ef-b4cd-80874e6eb77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67823c38-13a2-4fba-8c2d-b839a2c956f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67823c38-13a2-4fba-8c2d-b839a2c956f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673341886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df733cc6-e652-4725-8612-097dccc02621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:16Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b7b50c-3e1c-4b06-8eea-16e1d54b380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b7b50c-3e1c-4b06-8eea-16e1d54b380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700a8b51-da25-445c-a5b4-7d915fe8161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700a8b51-da25-445c-a5b4-7d915fe8161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df733cc6-e652-4725-8612-097dccc02621', 'volume_name': 'volume-df733cc6-e652-4725-8612-097dccc02621', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074e2065-0cbf-434b-b612-09ff6c1d822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074e2065-0cbf-434b-b612-09ff6c1d822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45acddac-248b-4f2d-964a-0dff6426cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Volume df733cc6-e652-4725-8612-097dccc02621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df733cc6-e652-4725-8612-097dccc02621', 'volume_size': 1} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673341886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df733cc6-e652-4725-8612-097dccc02621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:16Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Creating volume df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:15 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:45:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:16 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 1073741824 Jul 17 05:45:16 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:16 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 1073741824" returned: 0 in 0.470s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:16 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 Jul 17 05:45:16 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:16 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621" returned: 0 in 0.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45acddac-248b-4f2d-964a-0dff6426cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df733cc6-e652-4725-8612-097dccc02621', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb13b470-bac7-4796-bfce-f68e7906ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Volume volume-df733cc6-e652-4725-8612-097dccc02621 (df733cc6-e652-4725-8612-097dccc02621): created successfully Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb13b470-bac7-4796-bfce-f68e7906ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (5bc485b3-840d-43ef-b4cd-80874e6eb77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1d079117-7d2c-4239-9a94-48ca52ac36ab tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:45:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot 73836f50-64d4-46f8-9131-7db8c8cbf3a1 of volume df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:45:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[144d7b6a-1bcf-4823-ac2f-ee20c145d543]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:18 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 Jul 17 05:45:18 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:18 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621" returned: 0 in 0.398s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:18 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 1G Jul 17 05:45:18 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:19 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 1G" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df733cc6-e652-4725-8612-097dccc02621 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:19 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df733cc6-e652-4725-8612-097dccc02621 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 Jul 17 05:45:19 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:19 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df733cc6-e652-4725-8612-097dccc02621 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:19 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 is being set with open permissions: ugo+rw Jul 17 05:45:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:19 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 Jul 17 05:45:19 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:19 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:19 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.info Jul 17 05:45:19 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:20 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.info" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:20 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.info is being set with open permissions: ugo+rw Jul 17 05:45:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:20 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.info Jul 17 05:45:20 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:20 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.info" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6e9258c7-c97c-4544-8c0f-8615065263ee tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-73836f50-64d4-46f8-9131-7db8c8cbf3a1-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Lock "cinder-73836f50-64d4-46f8-9131-7db8c8cbf3a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-df733cc6-e652-4725-8612-097dccc02621" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-df733cc6-e652-4725-8612-097dccc02621" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-73836f50-64d4-46f8-9131-7db8c8cbf3a1" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-73836f50-64d4-46f8-9131-7db8c8cbf3a1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot 73836f50-64d4-46f8-9131-7db8c8cbf3a1 of volume df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa969ee-bc8d-414c-921c-d4741e4bd203]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:21 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 Jul 17 05:45:21 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:21 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df733cc6-e652-4725-8612-097dccc02621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[514daf29-e630-4ca0-93b5-88389f081c75]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:22 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 Jul 17 05:45:22 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:22 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:22 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 Jul 17 05:45:22 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:22 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:22 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1 Jul 17 05:45:22 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:22 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621.73836f50-64d4-46f8-9131-7db8c8cbf3a1" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-73836f50-64d4-46f8-9131-7db8c8cbf3a1" released by "_delete_snapshot" :: held 1.549s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-df733cc6-e652-4725-8612-097dccc02621" released by "delete_snapshot" :: held 1.573s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Created reservations ['08b714fa-b408-48c1-8f5c-49e07a2e378d', '36e54651-dcd7-4d74-88ad-6d80a4d8dce9', '1f551622-d979-45c4-90d1-2e85113d87a7', '20cf4a15-7c70-48a3-b6d7-2b41558b7913'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-943230cb-1cc1-4b2a-a74c-7dc7204abb3d tempest-ProjectMemberTests-1123032030 None] Lock "cinder-73836f50-64d4-46f8-9131-7db8c8cbf3a1-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-df733cc6-e652-4725-8612-097dccc02621-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-df733cc6-e652-4725-8612-097dccc02621-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-df733cc6-e652-4725-8612-097dccc02621" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-df733cc6-e652-4725-8612-097dccc02621" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b4742-2c5d-4536-93da-57d9554985d3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:23 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 Jul 17 05:45:23 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:24 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:24 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621 Jul 17 05:45:24 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:24 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-df733cc6-e652-4725-8612-097dccc02621" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-df733cc6-e652-4725-8612-097dccc02621" released by "delete_volume" :: held 0.641s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Created reservations ['f36b49db-6f53-480b-b8d3-3ddd3f7e8b05', '833f07f8-c94e-47dc-9e3b-83946206ae1b', 'f7336045-6c0a-4ec3-a5ed-5f568f6f29ee', 'b8ee1a96-c5f6-46b7-81e2-ab5659181927'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:24 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:24 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:24 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.236s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:45:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a3c02cde-5260-4f71-9ddf-617591d8f1c5 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-df733cc6-e652-4725-8612-097dccc02621-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (cb606c0f-98c3-44ef-9b03-7a7140e2f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6435d379-817c-41c2-9cea-229177aafa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6435d379-817c-41c2-9cea-229177aafa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108814686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8b80df-17d6-4869-a7d0-7bcb370bcef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:25Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f4a698-c54f-4633-9e70-dc23a4754b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f4a698-c54f-4633-9e70-dc23a4754b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e150031-c932-48b2-957f-0c805f19e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e150031-c932-48b2-957f-0c805f19e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce8b80df-17d6-4869-a7d0-7bcb370bcef9', 'volume_name': 'volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0daf312d-ea1b-4859-be3c-5d48284dc99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0daf312d-ea1b-4859-be3c-5d48284dc99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3d018a-be5e-4f04-9951-dc3ae25f2714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Volume ce8b80df-17d6-4869-a7d0-7bcb370bcef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9', 'volume_size': 1} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108814686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8b80df-17d6-4869-a7d0-7bcb370bcef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:25Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Creating volume ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:25 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:25 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 1073741824 Jul 17 05:45:25 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:25 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 1073741824" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:25 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 Jul 17 05:45:25 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:25 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3d018a-be5e-4f04-9951-dc3ae25f2714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c61503f-15c0-4d50-9cb9-84c3d739e315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Volume volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 (ce8b80df-17d6-4869-a7d0-7bcb370bcef9): created successfully Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c61503f-15c0-4d50-9cb9-84c3d739e315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (cb606c0f-98c3-44ef-9b03-7a7140e2f64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2a4f6b4c-73f3-4ed5-b8f9-c7bcc9e36355 tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:45:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot 821e78c6-4dfe-48b3-aa5c-7edc965ae60e of volume ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:45:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1cd2a4-ad34-4663-a87c-32eae148934d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:26 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 Jul 17 05:45:26 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:26 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:26 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e 1G Jul 17 05:45:26 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:27 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e 1G" returned: 0 in 0.367s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:27 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e Jul 17 05:45:27 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:27 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:27 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e is being set with open permissions: ugo+rw Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:27 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e Jul 17 05:45:27 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:27 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:27 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.info Jul 17 05:45:27 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:27 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.info" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:27 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.info is being set with open permissions: ugo+rw Jul 17 05:45:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:27 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.info Jul 17 05:45:27 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:28 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.info" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-44263fe4-6922-42e6-81bf-36291281ca81 tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-821e78c6-4dfe-48b3-aa5c-7edc965ae60e-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-821e78c6-4dfe-48b3-aa5c-7edc965ae60e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-821e78c6-4dfe-48b3-aa5c-7edc965ae60e" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-821e78c6-4dfe-48b3-aa5c-7edc965ae60e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot 821e78c6-4dfe-48b3-aa5c-7edc965ae60e of volume ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e4f9bd-2796-4f5f-831a-b5e4b3ce3f36]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:28 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e Jul 17 05:45:28 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:28 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cf1130-2073-4494-acd2-ea624899c3f7]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:29 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 Jul 17 05:45:29 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:29 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" returned: 0 in 0.343s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:29 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e Jul 17 05:45:29 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:29 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:29 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e Jul 17 05:45:29 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:29 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9.821e78c6-4dfe-48b3-aa5c-7edc965ae60e" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-821e78c6-4dfe-48b3-aa5c-7edc965ae60e" released by "_delete_snapshot" :: held 1.387s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" released by "delete_snapshot" :: held 1.412s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:INSERT=42,cinder:UPDATE=142,cinder:SELECT=121,cinder:DELETE=10 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=112,cinder:INSERT=38,cinder:UPDATE=163,cinder:DELETE=17 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:45:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Created reservations ['28c56efb-e044-42fe-b6c8-dcca3b1e6f9d', '27a3a4d2-4416-431e-8a7e-4074aa17b232', '1bbf83fb-fee2-42ae-a0c4-0c62fa4bb8e0', 'fe9cef12-c1a6-4651-ae50-79d82335f924'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:30 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:45:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70c7f4d-0a57-4356-95e3-758e1861d9d3 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-821e78c6-4dfe-48b3-aa5c-7edc965ae60e-delete_snapshot" released by "delete_snapshot" :: held 1.551s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-ce8b80df-17d6-4869-a7d0-7bcb370bcef9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-ce8b80df-17d6-4869-a7d0-7bcb370bcef9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b95669-53ac-4858-afc9-f11357d3ef03]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:30 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 Jul 17 05:45:30 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:31 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:31 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9 Jul 17 05:45:31 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:31 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-ce8b80df-17d6-4869-a7d0-7bcb370bcef9" released by "delete_volume" :: held 0.683s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Created reservations ['17bb597e-0264-4ed6-9909-9b4362d59271', 'd5633022-30da-4757-a78e-a464100d9d61', '639ded79-8826-4628-9ffc-b8be4923b3d3', 'c20bef60-5bcf-4432-8393-54e807258d22'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:31 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:31 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:31 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:45:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a382448d-0f56-4dd5-8705-d261d563cac9 tempest-ProjectMemberTests-1123032030 None] Lock "cinder-ce8b80df-17d6-4869-a7d0-7bcb370bcef9-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (dd3cf3c9-92be-426d-a6dc-988b83facb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036e5cfa-d141-44e1-9409-33c135a6bdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036e5cfa-d141-44e1-9409-33c135a6bdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566962372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1424d64-340d-4515-8b74-7b15f79d17fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:32Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ca1968-6ff3-49d2-920e-e887fa393eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ca1968-6ff3-49d2-920e-e887fa393eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf364a-5c36-4179-8159-2967ce3371fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf364a-5c36-4179-8159-2967ce3371fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1424d64-340d-4515-8b74-7b15f79d17fb', 'volume_name': 'volume-f1424d64-340d-4515-8b74-7b15f79d17fb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ba5ccd-cda5-478e-9a65-bfe33099a482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ba5ccd-cda5-478e-9a65-bfe33099a482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ba330c-2a00-4e1f-bb1d-b7f8f027b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Volume f1424d64-340d-4515-8b74-7b15f79d17fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1424d64-340d-4515-8b74-7b15f79d17fb', 'volume_size': 1} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566962372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1424d64-340d-4515-8b74-7b15f79d17fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0df4d4ce2649748a1b0b2e8ecb9cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:32Z,use_quota=True,user_id='9d96cfcd6b7f430d95d32d39520f93b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Creating volume f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:32 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:32 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb 1073741824 Jul 17 05:45:32 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:32 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb 1073741824" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:32 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb Jul 17 05:45:32 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:32 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb" returned: 0 in 0.231s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ba330c-2a00-4e1f-bb1d-b7f8f027b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1424d64-340d-4515-8b74-7b15f79d17fb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7ffa46-88a6-4da3-a16e-d6ce3fe1e5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Volume volume-f1424d64-340d-4515-8b74-7b15f79d17fb (f1424d64-340d-4515-8b74-7b15f79d17fb): created successfully Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7ffa46-88a6-4da3-a16e-d6ce3fe1e5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Flow 'volume_create_manager' (dd3cf3c9-92be-426d-a6dc-988b83facb6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d63d7c2d-d3f7-4bf2-8a07-903d198db45f tempest-ProjectMemberTests-1123032030 None] Created volume successfully. Jul 17 05:45:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Creating offline snapshot b8c9f67b-f95c-419c-b01a-f83beae6bcc7 of volume f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:45:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb61671-fb4b-42e8-86cb-44f5f3a1d003]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:33 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb Jul 17 05:45:33 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:33 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb" returned: 0 in 0.353s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:33 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 1G Jul 17 05:45:33 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:34 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 1G" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1424d64-340d-4515-8b74-7b15f79d17fb -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:34 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1424d64-340d-4515-8b74-7b15f79d17fb -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 Jul 17 05:45:34 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:34 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1424d64-340d-4515-8b74-7b15f79d17fb -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:34 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 is being set with open permissions: ugo+rw Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:34 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 Jul 17 05:45:34 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:34 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:34 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.info Jul 17 05:45:34 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:34 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.info" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:34 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.info is being set with open permissions: ugo+rw Jul 17 05:45:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:34 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.info Jul 17 05:45:34 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:35 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.info" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e64e3987-517f-4472-a274-b9afe9c6ba7a tempest-ProjectMemberTests-1123032030 None] Create snapshot completed successfully Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-b8c9f67b-f95c-419c-b01a-f83beae6bcc7-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-b8c9f67b-f95c-419c-b01a-f83beae6bcc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-f1424d64-340d-4515-8b74-7b15f79d17fb" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-f1424d64-340d-4515-8b74-7b15f79d17fb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-b8c9f67b-f95c-419c-b01a-f83beae6bcc7" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-b8c9f67b-f95c-419c-b01a-f83beae6bcc7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Deleting offline snapshot b8c9f67b-f95c-419c-b01a-f83beae6bcc7 of volume f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] snapshot_file for this snap is: volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8a768e-0aa4-4eec-a003-6b5dbe9f628c]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:35 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 Jul 17 05:45:35 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:35 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1424d64-340d-4515-8b74-7b15f79d17fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb993430-eecc-485a-a1d5-b8a1994b2d23]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:36 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb Jul 17 05:45:36 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:36 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb" returned: 0 in 0.338s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:36 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 Jul 17 05:45:36 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:36 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:36 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7 Jul 17 05:45:36 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:36 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb.b8c9f67b-f95c-419c-b01a-f83beae6bcc7" returned: 0 in 0.236s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-b8c9f67b-f95c-419c-b01a-f83beae6bcc7" released by "_delete_snapshot" :: held 1.328s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-f1424d64-340d-4515-8b74-7b15f79d17fb" released by "delete_snapshot" :: held 1.350s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Created reservations ['436e95fb-623b-4cf7-97ba-94208d705a93', 'ca98efa1-974b-443e-b552-b241de32f9e5', '91d37690-a903-4995-a102-e33d213504e4', '9f8d852e-f81c-4bd9-a11d-4a867c7bc549'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Delete snapshot completed successfully. Jul 17 05:45:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac8f59b7-05bb-46f9-99b1-48690d66e95a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-b8c9f67b-f95c-419c-b01a-f83beae6bcc7-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-f1424d64-340d-4515-8b74-7b15f79d17fb-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-f1424d64-340d-4515-8b74-7b15f79d17fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "cinder-quobyte-f1424d64-340d-4515-8b74-7b15f79d17fb" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-f1424d64-340d-4515-8b74-7b15f79d17fb" acquired by "delete_volume" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:37 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d54fd-244a-47ae-8e85-8fd2c3e7aacc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:37 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb Jul 17 05:45:37 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:38 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:38 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb Jul 17 05:45:38 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:38 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-f1424d64-340d-4515-8b74-7b15f79d17fb" returned: 0 in 0.230s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-quobyte-f1424d64-340d-4515-8b74-7b15f79d17fb" released by "delete_volume" :: held 0.628s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Created reservations ['9d53eb74-c53c-43b0-8f1a-e2cda448a894', '631f3cce-1930-4553-bbc9-4fc22f472165', '0af44309-def6-4541-953b-18a20e1e683d', '6d19ec5f-d801-404e-9f4f-010306610e7d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:38 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:38 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:38 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Deleted volume successfully. Jul 17 05:45:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2881b96-c7c6-4096-ada2-82facdbd435a tempest-ProjectMemberTests-1123032030 None] Lock "cinder-f1424d64-340d-4515-8b74-7b15f79d17fb-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (fae0b9d0-2dcf-4d43-83c2-901019f4df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51729d22-b451-4fca-b026-4693cc53210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51729d22-b451-4fca-b026-4693cc53210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066604764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b7db2-d476-4ed0-ae22-133857e0d392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:42Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce766577-c86f-426a-bc03-f71cea73fe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce766577-c86f-426a-bc03-f71cea73fe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f2a123-b04d-4080-9bbd-968d44fb8b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f2a123-b04d-4080-9bbd-968d44fb8b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230b7db2-d476-4ed0-ae22-133857e0d392', 'volume_name': 'volume-230b7db2-d476-4ed0-ae22-133857e0d392', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc86a95f-a21b-4d02-b131-e1417cd60b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc86a95f-a21b-4d02-b131-e1417cd60b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f06a34-a6ff-4f36-aa1e-cc084102fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Volume 230b7db2-d476-4ed0-ae22-133857e0d392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230b7db2-d476-4ed0-ae22-133857e0d392', 'volume_size': 1} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066604764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b7db2-d476-4ed0-ae22-133857e0d392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:42Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Creating volume 230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:42 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:42 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 1073741824 Jul 17 05:45:42 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:42 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 1073741824" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:43 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 Jul 17 05:45:43 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:43 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f06a34-a6ff-4f36-aa1e-cc084102fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230b7db2-d476-4ed0-ae22-133857e0d392', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febc2638-9bb1-47fa-9407-fc02798c097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Volume volume-230b7db2-d476-4ed0-ae22-133857e0d392 (230b7db2-d476-4ed0-ae22-133857e0d392): created successfully Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febc2638-9bb1-47fa-9407-fc02798c097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (fae0b9d0-2dcf-4d43-83c2-901019f4df3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2c63251a-12c1-49c0-9264-cdfbd8eaaca8 tempest-ProjectReaderTests-1407946251 None] Created volume successfully. Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Creating offline snapshot f58bdadc-963f-4efe-a34e-301d7f1b2a4a of volume 230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2a4c17-b615-4c28-ab7d-895d534789a1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:43 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 Jul 17 05:45:43 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:44 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:44 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a 1G Jul 17 05:45:44 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:44 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a 1G" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-230b7db2-d476-4ed0-ae22-133857e0d392 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:44 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-230b7db2-d476-4ed0-ae22-133857e0d392 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a Jul 17 05:45:44 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:44 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-230b7db2-d476-4ed0-ae22-133857e0d392 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:44 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a is being set with open permissions: ugo+rw Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:44 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a Jul 17 05:45:44 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:44 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:44 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.info Jul 17 05:45:44 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:45 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.info" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:45 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.info is being set with open permissions: ugo+rw Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:45 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.info Jul 17 05:45:45 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:45 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.info" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b92c8836-bc95-4ed6-bdaf-342cb1f46719 tempest-ProjectReaderTests-1407946251 None] Create snapshot completed successfully Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-f58bdadc-963f-4efe-a34e-301d7f1b2a4a-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-f58bdadc-963f-4efe-a34e-301d7f1b2a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-230b7db2-d476-4ed0-ae22-133857e0d392" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-230b7db2-d476-4ed0-ae22-133857e0d392" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-f58bdadc-963f-4efe-a34e-301d7f1b2a4a" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-f58bdadc-963f-4efe-a34e-301d7f1b2a4a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Deleting offline snapshot f58bdadc-963f-4efe-a34e-301d7f1b2a4a of volume 230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] snapshot_file for this snap is: volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8af028-4ddb-4ef4-a6b2-7e049af517b0]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:46 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a Jul 17 05:45:46 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:46 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-230b7db2-d476-4ed0-ae22-133857e0d392(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[55462062-f2b2-4d2f-ac11-1d3ef8c8e900]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:46 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 Jul 17 05:45:46 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:46 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:46 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a Jul 17 05:45:46 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:47 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:47 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a Jul 17 05:45:47 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:47 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392.f58bdadc-963f-4efe-a34e-301d7f1b2a4a" returned: 0 in 0.243s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-f58bdadc-963f-4efe-a34e-301d7f1b2a4a" released by "_delete_snapshot" :: held 1.448s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-230b7db2-d476-4ed0-ae22-133857e0d392" released by "delete_snapshot" :: held 1.469s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Created reservations ['d0298e99-4977-4f77-b292-8a09fee28406', 'ef01a610-51bc-4d17-bd6a-5762446153eb', 'ba0d799f-f2d9-4975-8063-5230fa33e1b4', '2423769f-2856-4e0f-8e3f-e88f37a12b2e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Delete snapshot completed successfully. Jul 17 05:45:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-34e9bac5-2c91-48f4-ad09-e056fb4a8b5d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-f58bdadc-963f-4efe-a34e-301d7f1b2a4a-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-230b7db2-d476-4ed0-ae22-133857e0d392-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-230b7db2-d476-4ed0-ae22-133857e0d392-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-230b7db2-d476-4ed0-ae22-133857e0d392" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-230b7db2-d476-4ed0-ae22-133857e0d392" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b0c99a-0629-4d08-9f19-c33dd0ae688d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:48 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 Jul 17 05:45:48 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:48 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:48 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392 Jul 17 05:45:48 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:48 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-230b7db2-d476-4ed0-ae22-133857e0d392" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-230b7db2-d476-4ed0-ae22-133857e0d392" released by "delete_volume" :: held 0.660s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Created reservations ['95f3d0bb-86a3-4f15-bf2d-ad58f5db9fc2', '34801ed0-12ac-43fe-bc80-01a19148f16b', '13e35949-8fe9-4e82-b7ef-0509e2dc3a97', '0efdd0fc-d4b0-4dba-b0e7-6a7e3f6440c7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:48 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:48 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:49 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Deleted volume successfully. Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b27153a2-beef-4852-b681-c7894b75e4c5 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-230b7db2-d476-4ed0-ae22-133857e0d392-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (bef7d745-66f2-4ccc-b687-3a7e8bd93ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925155a1-cfa1-4823-a8a7-8c3fd0614cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925155a1-cfa1-4823-a8a7-8c3fd0614cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584256726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340255a6-7e2a-4044-bb79-41762279f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:50Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1fab13-36b0-4c96-8dac-6495a27cb125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1fab13-36b0-4c96-8dac-6495a27cb125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801c4e94-767c-45f6-89e3-0ce1f0f4e225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801c4e94-767c-45f6-89e3-0ce1f0f4e225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340255a6-7e2a-4044-bb79-41762279f7f0', 'volume_name': 'volume-340255a6-7e2a-4044-bb79-41762279f7f0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b1dbfd-d78b-4503-99ff-452cbe6d94da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b1dbfd-d78b-4503-99ff-452cbe6d94da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2d91e2-830b-412a-bbc5-9b0a770d59b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Volume 340255a6-7e2a-4044-bb79-41762279f7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340255a6-7e2a-4044-bb79-41762279f7f0', 'volume_size': 1} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584256726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340255a6-7e2a-4044-bb79-41762279f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:50Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Creating volume 340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:49 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:45:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:49 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 1073741824 Jul 17 05:45:49 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:50 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 1073741824" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:50 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 Jul 17 05:45:50 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:50 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2d91e2-830b-412a-bbc5-9b0a770d59b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340255a6-7e2a-4044-bb79-41762279f7f0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9762fa58-75ae-4dc5-89a7-c897a089cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Volume volume-340255a6-7e2a-4044-bb79-41762279f7f0 (340255a6-7e2a-4044-bb79-41762279f7f0): created successfully Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9762fa58-75ae-4dc5-89a7-c897a089cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (bef7d745-66f2-4ccc-b687-3a7e8bd93ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e65ff5b1-03bf-4af0-bf8f-1876d8e55bae tempest-ProjectReaderTests-1407946251 None] Created volume successfully. Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Creating offline snapshot dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb of volume 340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb854cf-0855-4035-ad4b-f9ea0aac156e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:50 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 Jul 17 05:45:50 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:51 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:51 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb 1G Jul 17 05:45:51 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:51 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb 1G" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340255a6-7e2a-4044-bb79-41762279f7f0 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:51 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340255a6-7e2a-4044-bb79-41762279f7f0 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb Jul 17 05:45:51 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:51 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340255a6-7e2a-4044-bb79-41762279f7f0 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:51 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb is being set with open permissions: ugo+rw Jul 17 05:45:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:51 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb Jul 17 05:45:51 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:52 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:52 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.info Jul 17 05:45:52 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:52 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.info" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:52 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.info is being set with open permissions: ugo+rw Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:52 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.info Jul 17 05:45:52 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:52 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.info" returned: 0 in 0.227s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cd5bf7b8-8130-4e62-9944-f0306ec39b15 tempest-ProjectReaderTests-1407946251 None] Create snapshot completed successfully Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-340255a6-7e2a-4044-bb79-41762279f7f0" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-340255a6-7e2a-4044-bb79-41762279f7f0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Deleting offline snapshot dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb of volume 340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] snapshot_file for this snap is: volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[315caf58-6560-42be-b7c2-f2c97f7b430d]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:53 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb Jul 17 05:45:53 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:53 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" returned: 0 in 0.353s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-340255a6-7e2a-4044-bb79-41762279f7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5a6a91-93ea-451b-b8ac-d11af348e7f1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:53 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 Jul 17 05:45:53 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:53 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0" returned: 0 in 0.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:53 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb Jul 17 05:45:53 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:54 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:54 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb Jul 17 05:45:54 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:54 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0.dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" returned: 0 in 0.240s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb" released by "_delete_snapshot" :: held 1.349s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-340255a6-7e2a-4044-bb79-41762279f7f0" released by "delete_snapshot" :: held 1.374s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:54 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Created reservations ['3a82f717-3ee6-4e30-a1a9-19271ae8bf54', '0f30601a-53c8-4a14-ba4a-2d45fa98edb4', 'b2e7cfaa-92ac-4309-97ca-720f4a0f1238', '4ec33e96-efdd-4305-8a75-46b7b17e6d6c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Delete snapshot completed successfully. Jul 17 05:45:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-33a5f7c5-08f0-49a2-844f-62106468585d tempest-ProjectReaderTests-1407946251 None] Lock "cinder-dfad8187-e2e6-4cc2-9a7c-a2b8067d37eb-delete_snapshot" released by "delete_snapshot" :: held 1.573s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-340255a6-7e2a-4044-bb79-41762279f7f0-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-340255a6-7e2a-4044-bb79-41762279f7f0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-340255a6-7e2a-4044-bb79-41762279f7f0" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-340255a6-7e2a-4044-bb79-41762279f7f0" acquired by "delete_volume" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4ba21c-8768-441c-81d3-ce2bd991869f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:55 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 Jul 17 05:45:55 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:55 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:55 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0 Jul 17 05:45:55 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:55 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-340255a6-7e2a-4044-bb79-41762279f7f0" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-340255a6-7e2a-4044-bb79-41762279f7f0" released by "delete_volume" :: held 0.674s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Created reservations ['564a6491-8752-4ffa-bc54-dd61f62f9aea', 'a408b430-406f-471d-a364-4eaaa6e21014', '7ed42bc8-6502-42bd-bd82-f1337961f0a3', 'c627cdbb-d4ad-42fc-9728-c1b265f9586c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:55 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:55 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:56 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Deleted volume successfully. Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2a2699c-6ee2-4a36-abbe-ef627d8c48f8 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-340255a6-7e2a-4044-bb79-41762279f7f0-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:56 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:45:56 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (90186bd3-54db-4644-9c78-7fb1c64abe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efaf9e5-a6a4-4e01-a318-c12c15e5e51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:56 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efaf9e5-a6a4-4e01-a318-c12c15e5e51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327296372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c414bce0-aa7f-4281-baf6-77feaaafc3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:57Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d051e7-6166-4f12-80fb-52a150b5fea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d051e7-6166-4f12-80fb-52a150b5fea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715c6842-bc8b-41b9-9b5b-4f07e105fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715c6842-bc8b-41b9-9b5b-4f07e105fb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c414bce0-aa7f-4281-baf6-77feaaafc3f8', 'volume_name': 'volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caf9cca-d4b5-42ca-9d5c-3f279c150657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caf9cca-d4b5-42ca-9d5c-3f279c150657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce03ea83-956f-4100-9e2d-177595f18c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Volume c414bce0-aa7f-4281-baf6-77feaaafc3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8', 'volume_size': 1} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327296372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c414bce0-aa7f-4281-baf6-77feaaafc3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:45:57Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Creating volume c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:45:56 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:45:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 05:45:56 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 1073741824 Jul 17 05:45:56 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:57 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 1073741824" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:57 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 Jul 17 05:45:57 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:57 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8" returned: 0 in 0.236s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce03ea83-956f-4100-9e2d-177595f18c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f96a0df-4a22-4693-a21c-7a3d6c6e1655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:45:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Volume volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 (c414bce0-aa7f-4281-baf6-77feaaafc3f8): created successfully Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f96a0df-4a22-4693-a21c-7a3d6c6e1655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (90186bd3-54db-4644-9c78-7fb1c64abe5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:45:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7ce654f7-0410-485e-a7a6-20228e760f58 tempest-ProjectReaderTests-1407946251 None] Created volume successfully. Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Creating offline snapshot fce06163-5eb0-4555-a858-b7b8e7ef88eb of volume c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d37a187-10a0-4e07-81ed-bff66c14dccc]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:45:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:57 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 Jul 17 05:45:57 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:58 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8" returned: 0 in 0.371s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:58 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb 1G Jul 17 05:45:58 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:58 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb 1G" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:58 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb Jul 17 05:45:58 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:58 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:58 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb is being set with open permissions: ugo+rw Jul 17 05:45:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:58 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb Jul 17 05:45:58 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:59 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:59 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.info Jul 17 05:45:59 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:59 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.info" returned: 0 in 0.244s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:59 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.info is being set with open permissions: ugo+rw Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:45:59 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.info Jul 17 05:45:59 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:45:59 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.info" returned: 0 in 0.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:45:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7687356a-283a-405e-ba5f-49e2a0dc79ce tempest-ProjectReaderTests-1407946251 None] Create snapshot completed successfully Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-fce06163-5eb0-4555-a858-b7b8e7ef88eb-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Lock "cinder-fce06163-5eb0-4555-a858-b7b8e7ef88eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:45:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-c414bce0-aa7f-4281-baf6-77feaaafc3f8" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-c414bce0-aa7f-4281-baf6-77feaaafc3f8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-fce06163-5eb0-4555-a858-b7b8e7ef88eb" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-fce06163-5eb0-4555-a858-b7b8e7ef88eb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Deleting offline snapshot fce06163-5eb0-4555-a858-b7b8e7ef88eb of volume c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] snapshot_file for this snap is: volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a10db-75aa-4650-ab02-8a0e2eb5c87a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:00 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb Jul 17 05:46:00 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:00 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb" returned: 0 in 0.351s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0363ab5b-9cd5-4fbb-89da-7874dfb94613]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:00 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 Jul 17 05:46:00 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:00 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:00 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb Jul 17 05:46:00 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:01 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:01 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb Jul 17 05:46:01 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:01 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8.fce06163-5eb0-4555-a858-b7b8e7ef88eb" returned: 0 in 0.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-fce06163-5eb0-4555-a858-b7b8e7ef88eb" released by "_delete_snapshot" :: held 1.351s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-c414bce0-aa7f-4281-baf6-77feaaafc3f8" released by "delete_snapshot" :: held 1.370s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Created reservations ['5bb8537c-3093-41ac-b513-dfc6128c07e2', '59a486c7-fb7f-4bdc-b249-c64e7dd4cdbc', '792c198a-a3d7-4807-871b-a78e40ff82a7', 'e4bd42fd-674c-456b-a398-65a2a986b48f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Delete snapshot completed successfully. Jul 17 05:46:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-17170a5a-34b7-4a23-b29b-6b716c88e22b tempest-ProjectReaderTests-1407946251 None] Lock "cinder-fce06163-5eb0-4555-a858-b7b8e7ef88eb-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-c414bce0-aa7f-4281-baf6-77feaaafc3f8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-c414bce0-aa7f-4281-baf6-77feaaafc3f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-c414bce0-aa7f-4281-baf6-77feaaafc3f8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-c414bce0-aa7f-4281-baf6-77feaaafc3f8" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20fc03b-6c9a-4e14-b580-8ac66091278a]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:02 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 Jul 17 05:46:02 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:02 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:02 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8 Jul 17 05:46:02 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:02 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-c414bce0-aa7f-4281-baf6-77feaaafc3f8" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-c414bce0-aa7f-4281-baf6-77feaaafc3f8" released by "delete_volume" :: held 0.671s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Created reservations ['80df78be-d478-4755-8545-7b51528ebf2d', '5e73d4e6-e61a-42ed-a489-978f925eb43a', '5766cc8f-96f3-4127-8209-b1dcfaa86985', '1d16b8f1-42f6-4ac1-8520-7a9e4580d281'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:02 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:02 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:03 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Deleted volume successfully. Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2539d7e1-964b-4999-9ef7-275fdc00f8b3 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-c414bce0-aa7f-4281-baf6-77feaaafc3f8-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (76e9458a-cea5-4598-90e1-84d7c59c065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e9bd93-c246-48ed-abaf-019b3f1ed3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e9bd93-c246-48ed-abaf-019b3f1ed3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697167210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0b28ac-3652-44d3-97f5-7fec27616023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:04Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27355cf7-2311-43e1-b5de-5f5643fc04a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27355cf7-2311-43e1-b5de-5f5643fc04a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c98fac-a8b2-4e7e-9a71-76ec9376afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c98fac-a8b2-4e7e-9a71-76ec9376afc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0b28ac-3652-44d3-97f5-7fec27616023', 'volume_name': 'volume-1e0b28ac-3652-44d3-97f5-7fec27616023', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a03fd3-1284-4a8f-9fa6-db7ae2d388e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a03fd3-1284-4a8f-9fa6-db7ae2d388e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338ca77e-6020-4c41-b4d7-f348c267a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Volume 1e0b28ac-3652-44d3-97f5-7fec27616023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0b28ac-3652-44d3-97f5-7fec27616023', 'volume_size': 1} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697167210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0b28ac-3652-44d3-97f5-7fec27616023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:04Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Creating volume 1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:46:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:46:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:03 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 1073741824 Jul 17 05:46:03 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:04 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 1073741824" returned: 0 in 0.412s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:04 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 Jul 17 05:46:04 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:04 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338ca77e-6020-4c41-b4d7-f348c267a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0b28ac-3652-44d3-97f5-7fec27616023', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5624acc3-b396-4aa0-ae4c-c235fafb1229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Volume volume-1e0b28ac-3652-44d3-97f5-7fec27616023 (1e0b28ac-3652-44d3-97f5-7fec27616023): created successfully Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5624acc3-b396-4aa0-ae4c-c235fafb1229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (76e9458a-cea5-4598-90e1-84d7c59c065a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-074c5470-8d4e-418e-945c-052adf63915f tempest-ProjectReaderTests-1407946251 None] Created volume successfully. Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Creating offline snapshot 9b20d341-6152-45f3-b35e-c839b953d919 of volume 1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c638def4-6271-4200-bae2-3fedf23a8861]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:05 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 Jul 17 05:46:05 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:05 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:05 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 1G Jul 17 05:46:05 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:05 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 1G" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0b28ac-3652-44d3-97f5-7fec27616023 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:05 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0b28ac-3652-44d3-97f5-7fec27616023 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 Jul 17 05:46:05 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:06 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0b28ac-3652-44d3-97f5-7fec27616023 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:06 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 is being set with open permissions: ugo+rw Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:06 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 Jul 17 05:46:06 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:06 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919" returned: 0 in 0.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:06 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.info Jul 17 05:46:06 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:06 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.info" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:06 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.info is being set with open permissions: ugo+rw Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:06 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.info Jul 17 05:46:06 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:06 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.info" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4eea4f3f-89f2-46d0-8482-7cf22f3f5586 tempest-ProjectReaderTests-1407946251 None] Create snapshot completed successfully Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-9b20d341-6152-45f3-b35e-c839b953d919-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-9b20d341-6152-45f3-b35e-c839b953d919-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-1e0b28ac-3652-44d3-97f5-7fec27616023" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-1e0b28ac-3652-44d3-97f5-7fec27616023" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-9b20d341-6152-45f3-b35e-c839b953d919" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-9b20d341-6152-45f3-b35e-c839b953d919" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Deleting offline snapshot 9b20d341-6152-45f3-b35e-c839b953d919 of volume 1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] snapshot_file for this snap is: volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9100213-fd7e-4a5d-a8b6-e7c4dc7eb7ab]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:07 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 Jul 17 05:46:07 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:07 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e0b28ac-3652-44d3-97f5-7fec27616023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab59b9f-92c1-474d-aa56-bfdc47f50db4]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:07 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 Jul 17 05:46:07 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:07 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:07 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 Jul 17 05:46:07 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:08 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:08 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919 Jul 17 05:46:08 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:08 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023.9b20d341-6152-45f3-b35e-c839b953d919" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-9b20d341-6152-45f3-b35e-c839b953d919" released by "_delete_snapshot" :: held 1.351s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-1e0b28ac-3652-44d3-97f5-7fec27616023" released by "delete_snapshot" :: held 1.370s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Created reservations ['b02839a6-548b-4b60-8e24-448d93774c06', '553c7c16-1edf-425a-ae9f-4a8edd5e910c', '3ed59e87-247e-4ecd-8b5b-ef03d82cc834', '8328b8df-42e7-49e7-a330-d4eb002bbaf7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Delete snapshot completed successfully. Jul 17 05:46:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7cfbb170-dc7a-449b-8f6c-687be09dad65 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-9b20d341-6152-45f3-b35e-c839b953d919-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-1e0b28ac-3652-44d3-97f5-7fec27616023-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Lock "cinder-1e0b28ac-3652-44d3-97f5-7fec27616023-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-1e0b28ac-3652-44d3-97f5-7fec27616023" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-1e0b28ac-3652-44d3-97f5-7fec27616023" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14e287-71f9-432f-8e85-a401490397f3]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:09 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 Jul 17 05:46:09 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:09 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023" returned: 0 in 0.351s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:09 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023 Jul 17 05:46:09 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:09 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-1e0b28ac-3652-44d3-97f5-7fec27616023" returned: 0 in 0.229s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-1e0b28ac-3652-44d3-97f5-7fec27616023" released by "delete_volume" :: held 0.632s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Created reservations ['6752f22b-fc14-4f31-b2ae-f4a90bc7be0e', '54684d0f-c5d3-4ba9-9015-8c43bc5c3d1f', 'd16eae2f-9ff5-42c1-a5ad-dcce5f0f3167', '22ab4a6d-527e-4dcd-beba-973d5aa480dc'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:10 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:10 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:10 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Deleted volume successfully. Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b08032de-f14e-4eb6-ae09-25f0186956dc tempest-ProjectReaderTests-1407946251 None] Lock "cinder-1e0b28ac-3652-44d3-97f5-7fec27616023-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (51ebfad4-c685-4236-b2fb-4f671abd53cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad42dd68-e4da-46f8-8a22-832fac296ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad42dd68-e4da-46f8-8a22-832fac296ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323475198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b21f26-6915-45d3-8b07-54716239ccd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:11Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6619ee3-96b6-48c0-8de2-21051c3ad572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6619ee3-96b6-48c0-8de2-21051c3ad572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333bc6c0-90af-4939-b9a8-681741ffa401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333bc6c0-90af-4939-b9a8-681741ffa401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b21f26-6915-45d3-8b07-54716239ccd8', 'volume_name': 'volume-74b21f26-6915-45d3-8b07-54716239ccd8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846aacf1-e0dc-4f6a-912f-bde00d7a01ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846aacf1-e0dc-4f6a-912f-bde00d7a01ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88243836-6ef0-4853-a5f0-8c6a46e401c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Volume 74b21f26-6915-45d3-8b07-54716239ccd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b21f26-6915-45d3-8b07-54716239ccd8', 'volume_size': 1} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323475198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b21f26-6915-45d3-8b07-54716239ccd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e1c18aaea54165af0e6d2354ca1124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:11Z,use_quota=True,user_id='243a0d5ac7bb442a8c9e9d4c1945a619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Creating volume 74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:46:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:11 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 1073741824 Jul 17 05:46:11 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:11 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 1073741824" returned: 0 in 0.381s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:11 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 Jul 17 05:46:11 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:11 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88243836-6ef0-4853-a5f0-8c6a46e401c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b21f26-6915-45d3-8b07-54716239ccd8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b244b6-2c95-4e43-99bc-a822cce38cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Volume volume-74b21f26-6915-45d3-8b07-54716239ccd8 (74b21f26-6915-45d3-8b07-54716239ccd8): created successfully Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b244b6-2c95-4e43-99bc-a822cce38cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Flow 'volume_create_manager' (51ebfad4-c685-4236-b2fb-4f671abd53cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-55755198-56e6-4154-985d-a565bdba406d tempest-ProjectReaderTests-1407946251 None] Created volume successfully. Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Creating offline snapshot 4e561f63-273b-4381-94fb-dca968e03146 of volume 74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[988d67fc-a46c-4abc-9acb-bdecc227142e]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:12 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 Jul 17 05:46:12 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:12 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:12 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 1G Jul 17 05:46:12 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:12 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 1G" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b21f26-6915-45d3-8b07-54716239ccd8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:12 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b21f26-6915-45d3-8b07-54716239ccd8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 Jul 17 05:46:12 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:13 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b21f26-6915-45d3-8b07-54716239ccd8 -F qcow2 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 is being set with open permissions: ugo+rw Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:13 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 Jul 17 05:46:13 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:13 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146" returned: 0 in 0.225s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:13 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.info Jul 17 05:46:13 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:13 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.info" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.info is being set with open permissions: ugo+rw Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:13 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.info Jul 17 05:46:13 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:13 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.info" returned: 0 in 0.229s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.745s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4de2f22c-71f6-452b-b7d3-8bd4fa780200 tempest-ProjectReaderTests-1407946251 None] Create snapshot completed successfully Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-4e561f63-273b-4381-94fb-dca968e03146-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-4e561f63-273b-4381-94fb-dca968e03146-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-74b21f26-6915-45d3-8b07-54716239ccd8" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-74b21f26-6915-45d3-8b07-54716239ccd8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-4e561f63-273b-4381-94fb-dca968e03146" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-4e561f63-273b-4381-94fb-dca968e03146" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Deleting offline snapshot 4e561f63-273b-4381-94fb-dca968e03146 of volume 74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] snapshot_file for this snap is: volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e671496-dc8d-476e-9ebe-52dbe2bd9e7f]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:14 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 Jul 17 05:46:14 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:14 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74b21f26-6915-45d3-8b07-54716239ccd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38a3bf8-d9d3-4ed5-af3b-3595744d17d1]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:14 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 Jul 17 05:46:14 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:14 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:15 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 Jul 17 05:46:15 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:15 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146" returned: 0 in 0.316s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:15 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146 Jul 17 05:46:15 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:15 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8.4e561f63-273b-4381-94fb-dca968e03146" returned: 0 in 0.230s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-4e561f63-273b-4381-94fb-dca968e03146" released by "_delete_snapshot" :: held 1.311s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-74b21f26-6915-45d3-8b07-54716239ccd8" released by "delete_snapshot" :: held 1.332s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Created reservations ['b50ffa59-75ef-4d29-a905-b667b7e81800', '5d4bbf37-fbec-4b76-b3e0-e74eb8a916e7', '9d91b00f-0789-4fa1-b37f-d958ae9fc127', '5d28507e-aded-4734-b053-2cf69d1ec1ce'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Delete snapshot completed successfully. Jul 17 05:46:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-edb42baf-3119-4464-a609-1fe42fc1cf52 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-4e561f63-273b-4381-94fb-dca968e03146-delete_snapshot" released by "delete_snapshot" :: held 1.459s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-74b21f26-6915-45d3-8b07-54716239ccd8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-74b21f26-6915-45d3-8b07-54716239ccd8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "cinder-quobyte-74b21f26-6915-45d3-8b07-54716239ccd8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-74b21f26-6915-45d3-8b07-54716239ccd8" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2f0ba4-1a0f-41e2-86cd-a6b5a02c5e79]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:16 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 Jul 17 05:46:16 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:16 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:16 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8 Jul 17 05:46:16 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:17 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-74b21f26-6915-45d3-8b07-54716239ccd8" returned: 0 in 0.226s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-quobyte-74b21f26-6915-45d3-8b07-54716239ccd8" released by "delete_volume" :: held 0.655s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Created reservations ['0bf443b5-3286-4c94-8631-dbbd6675979d', '2552ecba-71af-4350-8b36-9c8f234c08de', 'b3c8fac2-e634-4f4a-9b32-5a973e16fcfe', '64fdcf5f-83ab-4cda-a3ca-f764856ca1b9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:17 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:17 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:17 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.227s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Deleted volume successfully. Jul 17 05:46:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f7d911d6-facc-452d-bcaf-8ff0fcd51655 tempest-ProjectReaderTests-1407946251 None] Lock "cinder-74b21f26-6915-45d3-8b07-54716239ccd8-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:27 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=96,cinder:INSERT=42,cinder:UPDATE=118,cinder:DELETE=11 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:46:27 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:INSERT=26,cinder:UPDATE=125,cinder:SELECT=89,cinder:DELETE=8 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (5c95c0df-1fe3-45a4-99b1-12d85ba49581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7adace-d540-4173-a646-66e06b712465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7adace-d540-4173-a646-66e06b712465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336229655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8365b062-28da-4da5-9b90-fb0c76a6df05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:29Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bdaf41-2616-497f-8eff-c81e5625bd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bdaf41-2616-497f-8eff-c81e5625bd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050659b7-e77d-4da0-92f3-968f62393b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050659b7-e77d-4da0-92f3-968f62393b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8365b062-28da-4da5-9b90-fb0c76a6df05', 'volume_name': 'volume-8365b062-28da-4da5-9b90-fb0c76a6df05', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4f2950-3877-431b-b5ca-7b3e1902b592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4f2950-3877-431b-b5ca-7b3e1902b592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484b76dc-cbca-48cd-ba54-73cb14b0b1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Volume 8365b062-28da-4da5-9b90-fb0c76a6df05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8365b062-28da-4da5-9b90-fb0c76a6df05', 'volume_size': 1} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336229655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8365b062-28da-4da5-9b90-fb0c76a6df05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:29Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Creating volume 8365b062-28da-4da5-9b90-fb0c76a6df05 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:46:29 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:29 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 1073741824 Jul 17 05:46:29 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:29 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 1073741824" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:29 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 Jul 17 05:46:29 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:29 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484b76dc-cbca-48cd-ba54-73cb14b0b1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8365b062-28da-4da5-9b90-fb0c76a6df05', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ad8a2d-6370-4c23-ac1d-bf14a7539763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Volume volume-8365b062-28da-4da5-9b90-fb0c76a6df05 (8365b062-28da-4da5-9b90-fb0c76a6df05): created successfully Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ad8a2d-6370-4c23-ac1d-bf14a7539763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (5c95c0df-1fe3-45a4-99b1-12d85ba49581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-82641050-2452-4df3-a97f-f9995a0c9b5a tempest-ProjectReaderTests-1353491279 None] Created volume successfully. Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-8365b062-28da-4da5-9b90-fb0c76a6df05-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-8365b062-28da-4da5-9b90-fb0c76a6df05-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-quobyte-8365b062-28da-4da5-9b90-fb0c76a6df05" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-8365b062-28da-4da5-9b90-fb0c76a6df05" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e54c8-a432-41fc-9ff3-fdfdfaea6e65]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:30 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 Jul 17 05:46:30 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:30 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:30 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05 Jul 17 05:46:30 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:30 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-8365b062-28da-4da5-9b90-fb0c76a6df05" returned: 0 in 0.230s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-8365b062-28da-4da5-9b90-fb0c76a6df05" released by "delete_volume" :: held 0.607s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Created reservations ['fd5d1a7f-f0ec-4853-b56b-66c26359c11d', '20e4624c-badd-4f10-b420-aebf3fa4bec9', '0713aab8-59aa-41a2-b7d4-926f14fcb130', 'b96aafda-ee61-496c-af07-730b1da7114f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:31 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:31 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:31 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Deleted volume successfully. Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c23fbe5d-1b94-467d-bf93-d94519ea78d1 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-8365b062-28da-4da5-9b90-fb0c76a6df05-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (9bffd553-da60-46c6-a0a5-d2cd3f0e546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d61398-c92f-4d82-ba4c-c0d51f6a87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d61398-c92f-4d82-ba4c-c0d51f6a87ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272555709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d9fc52-17cd-4150-a26b-f9476f5d742c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:32Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60aa952-47a5-438a-b72f-2afb7a62afde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60aa952-47a5-438a-b72f-2afb7a62afde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7750fdd3-c1c0-43c0-ae03-99f48583054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7750fdd3-c1c0-43c0-ae03-99f48583054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d9fc52-17cd-4150-a26b-f9476f5d742c', 'volume_name': 'volume-49d9fc52-17cd-4150-a26b-f9476f5d742c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a668650-a182-4ea7-8fcb-9143ef2dbee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a668650-a182-4ea7-8fcb-9143ef2dbee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cc339e-6a6b-4d37-9221-7e0c580a22e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Volume 49d9fc52-17cd-4150-a26b-f9476f5d742c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d9fc52-17cd-4150-a26b-f9476f5d742c', 'volume_size': 1} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272555709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d9fc52-17cd-4150-a26b-f9476f5d742c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:32Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Creating volume 49d9fc52-17cd-4150-a26b-f9476f5d742c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:46:31 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:46:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:31 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c 1073741824 Jul 17 05:46:31 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:32 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c 1073741824" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:32 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c Jul 17 05:46:32 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:32 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c" returned: 0 in 0.227s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cc339e-6a6b-4d37-9221-7e0c580a22e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d9fc52-17cd-4150-a26b-f9476f5d742c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572ced4d-a042-4586-a1de-217c4ef3be0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Volume volume-49d9fc52-17cd-4150-a26b-f9476f5d742c (49d9fc52-17cd-4150-a26b-f9476f5d742c): created successfully Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572ced4d-a042-4586-a1de-217c4ef3be0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (9bffd553-da60-46c6-a0a5-d2cd3f0e546e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8b28459c-32d8-482b-bb59-eb6482970e19 tempest-ProjectReaderTests-1353491279 None] Created volume successfully. Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-49d9fc52-17cd-4150-a26b-f9476f5d742c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-49d9fc52-17cd-4150-a26b-f9476f5d742c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-quobyte-49d9fc52-17cd-4150-a26b-f9476f5d742c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-49d9fc52-17cd-4150-a26b-f9476f5d742c" acquired by "delete_volume" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbdd5c6-a7b6-472f-b0f1-50b429d8f131]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:33 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c Jul 17 05:46:33 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:33 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:33 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c Jul 17 05:46:33 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:33 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-49d9fc52-17cd-4150-a26b-f9476f5d742c" returned: 0 in 0.228s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-49d9fc52-17cd-4150-a26b-f9476f5d742c" released by "delete_volume" :: held 0.596s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Created reservations ['a351526f-414f-4b2d-a9e5-51a39457e021', 'd7d5cd40-49e8-4321-baf3-8b48aa978ae0', '48e5918b-afea-47d6-8bf2-fd7978120aa9', '849da220-d8e8-44ae-9f97-cd59b7f7c9fb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:33 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:33 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:33 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.229s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Deleted volume successfully. Jul 17 05:46:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-516825cd-7d77-4e60-93da-9ad714771878 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-49d9fc52-17cd-4150-a26b-f9476f5d742c-delete_volume" released by "delete_volume" :: held 0.999s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (80b34e9c-4fda-4a93-8349-1515eaf69212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80658b23-eb66-42ea-a101-ca88b9f20363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80658b23-eb66-42ea-a101-ca88b9f20363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966521691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98075bbd-fed9-4dfb-ac01-4961440aaf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:34Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a259061-2f5d-420b-8c9a-f301a5fac52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a259061-2f5d-420b-8c9a-f301a5fac52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd16a82-93df-4739-bda9-d8856ce3c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd16a82-93df-4739-bda9-d8856ce3c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98075bbd-fed9-4dfb-ac01-4961440aaf8b', 'volume_name': 'volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d54ba28-b514-4781-9c08-d214818edb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d54ba28-b514-4781-9c08-d214818edb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d83439d-374a-4d94-a6bf-9511acd33e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Volume 98075bbd-fed9-4dfb-ac01-4961440aaf8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b', 'volume_size': 1} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966521691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98075bbd-fed9-4dfb-ac01-4961440aaf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:34Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Creating volume 98075bbd-fed9-4dfb-ac01-4961440aaf8b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:46:34 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:34 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b 1073741824 Jul 17 05:46:34 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:34 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b 1073741824" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:34 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b Jul 17 05:46:34 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:35 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b" returned: 0 in 0.229s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] <== create_volume: return (652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d83439d-374a-4d94-a6bf-9511acd33e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15045a61-e9ed-4021-9575-dd13ea0ac720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Volume volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b (98075bbd-fed9-4dfb-ac01-4961440aaf8b): created successfully Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15045a61-e9ed-4021-9575-dd13ea0ac720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (80b34e9c-4fda-4a93-8349-1515eaf69212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b4389c6d-d378-4909-8248-d0246f6ef8e7 tempest-ProjectReaderTests-1353491279 None] Created volume successfully. Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-98075bbd-fed9-4dfb-ac01-4961440aaf8b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-98075bbd-fed9-4dfb-ac01-4961440aaf8b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-quobyte-98075bbd-fed9-4dfb-ac01-4961440aaf8b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-98075bbd-fed9-4dfb-ac01-4961440aaf8b" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd63151-e54d-4187-a8e0-f23611401989]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:35 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b Jul 17 05:46:35 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:35 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:35 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b Jul 17 05:46:35 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:36 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-98075bbd-fed9-4dfb-ac01-4961440aaf8b" returned: 0 in 0.228s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-98075bbd-fed9-4dfb-ac01-4961440aaf8b" released by "delete_volume" :: held 0.594s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Created reservations ['ebf005d0-6d6c-46bc-abbf-bb454b65ee67', '46c8d47b-87a5-4563-8625-dec42b1863d8', 'f2ff2df8-c564-4b55-a92c-1ca021291eec', '45edc5c9-93de-4eb6-aafb-36c7b843e444'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:36 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:36 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:36 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.226s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Deleted volume successfully. Jul 17 05:46:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a96c4fd-2767-4d15-916e-fc1615302f98 tempest-ProjectReaderTests-1353491279 None] Lock "cinder-98075bbd-fed9-4dfb-ac01-4961440aaf8b-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (678ffd03-d06e-40b7-bfdd-1034b4a5c214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee7d026-6410-4671-b45a-1be4cf5f249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee7d026-6410-4671-b45a-1be4cf5f249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1385573393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cec659f-0a93-4ef6-84d7-3b6f4a198ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:37Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2698f329-fdd3-402d-8bcc-d9b0ad10f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2698f329-fdd3-402d-8bcc-d9b0ad10f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0f4cde-a361-489f-839f-9ddcff5e4567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0f4cde-a361-489f-839f-9ddcff5e4567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cec659f-0a93-4ef6-84d7-3b6f4a198ff8', 'volume_name': 'volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1fb5ab-d154-4cb3-88d0-62c9a26b3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1fb5ab-d154-4cb3-88d0-62c9a26b3566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09f3628-9355-4345-bb53-297874dbeb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Volume 3cec659f-0a93-4ef6-84d7-3b6f4a198ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8', 'volume_size': 1} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T03:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1385573393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cec659f-0a93-4ef6-84d7-3b6f4a198ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22824d611d0c42abb9aae674c24892b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T03:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T03:46:37Z,use_quota=True,user_id='4efcb007fb7640dbadab7ab2a709adf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f5a351-53d4-43cd-848b-561990ba9d28),volume_type_id=03f5a351-53d4-43cd-848b-561990ba9d28)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Creating volume 3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Selected osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 05:46:37 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] casted to osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041 Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:37 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 1073741824 Jul 17 05:46:37 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:37 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 1073741824" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:37 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 Jul 17 05:46:37 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:37 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09f3628-9355-4345-bb53-297874dbeb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39363ea4-3a3f-442c-ba50-49f64586a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 05:46:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Volume volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 (3cec659f-0a93-4ef6-84d7-3b6f4a198ff8): created successfully Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39363ea4-3a3f-442c-ba50-49f64586a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 05:46:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Flow 'volume_create_manager' (678ffd03-d06e-40b7-bfdd-1034b4a5c214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 05:46:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d809316d-b602-41e0-bb5d-3859b3a8dc32 tempest-ProjectReaderTests-1353491279 None] Created volume successfully. Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Lock "cinder-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Acquiring lock "cinder-quobyte-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade032a-a7c6-4d82-838a-4ad8e2ceee2b]: (4, 'qcow2') {{(pid=88611) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:38 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 Jul 17 05:46:38 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:38 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:38 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8 Jul 17 05:46:38 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:38 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8/volume-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8" returned: 0 in 0.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Lock "cinder-quobyte-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8" released by "delete_volume" :: held 0.609s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Created reservations ['e54c1e99-0365-4fec-a407-a2996ef939fe', '3cd4836c-055a-41a5-82ed-24b10eee7353', 'f90c16a9-62e6-4ca5-8008-c611b0ac26bb', '8a562680-3b9b-4c2b-954c-19eecf635c54'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:38 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:38 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:39 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:39 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Deleted volume successfully. Jul 17 05:46:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b01f9944-eae8-4831-b292-de95314f6bca tempest-ProjectReaderTests-1353491279 None] Lock "cinder-3cec659f-0a93-4ef6-84d7-3b6f4a198ff8-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 05:46:48 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=22,cinder:UPDATE=46,cinder:INSERT=9,cinder:DELETE=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:46:49 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=42,cinder:SELECT=34,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90b1051a-b0fa-44ea-8ca8-19d2915a6041'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 05:46:56 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8 Jul 17 05:46:56 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 05:46:56 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb8f24788904c3d977af31c3c7c938c8" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 05:46:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3706d10d-64c1-461a-96b1-13208d917c37 None None] thread info: [<_MainThread(MainThread, started 126645778108544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}